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(54) REPRODUCTION DEVICE, PROGRAM, REPRODUCTION METHOD 



(57) When playing an AV Clip recorded on a 
BD-ROM, a judgment is made, for each elementary 
stream, which of a plurality of predetermined conditions 
the elementary stream satisfies. The plurality of prede- 
termined conditions include (a) a condition that a play- 
back apparatus has acapability of playing the elementary 
stream, (b) a language attribute of the elementary stream 
matches a language setting of the playback apparatus, 
and (c) a channel attribute of the elementary stream is 
surround sound and the playback apparatus has a sur- 
round output capability. The playback apparatus assigns 
a priority to each elementary stream based on which con- 
ditions the elementary stream satisfies, selects an ele- 
mentary stream having a highest priority, and plays the 
selected elementary stream. 
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Description 

Technical Field 

[0001] The present invention relates to a playback ap- 
paratus for a recording medium, and in particular relates 
to improvements in a function of selecting one of a plu- 
rality of elementary streams and playing back the select- 
ed elementary stream. 

Background Art 

[0002J In distribution of movie content in recent years, 
the number of streams multiplexed to form one digital 
stream is on the increase. In view of this, the stream 
selection function mentioned above is regarded as par- 
ticularly important. The increase in the number of streams 
is due to an attempt to support every combination of co- 
dec, channel number, and language attribute. 
[0003] Suppose there are three codecs AC-3 (2ch) , 
AC-3 (5.1ch), and DTS (5.1ch), and two language at- 
tributes Japanese and English. In this case, six audio 
streams corresponding to six combinations of these co- 
decs and language attributes are produced and multi- 
plexed to form one digital stream. These audio streams 
have a specific numbering system. Accordingly, by set- 
ting a stream number of one of the audio streams in a 
status register in a playback apparatus so that the play- 
back apparatus selects the audio stream identified by the 
stream number in the status register, the audio stream 
corresponding to the particular codec-language combi- 
nation can be played at each playback session. 
[0004] The status register used here is initializedupon 
factory shipment, and may be updated later by the user. 
[0005] In the above playback apparatus, the status 
register is unchanged unless the user updates it. This 
being so, once the status register has been set to indi- 
cate, for example, AC-3 (2ch), even when content in- 
cludes an AC-3 (5.1ch) audio stream, the AC-3 (5.1 ch) 
audio stream is not played unless the user updates the 
status register. In this case, the AC-3 (5.1 ch) audio 
stream is wasted. To avoid this, it may be suggested to 
provide the playback apparatus with a function of auto- 
matically setting the status register so as to utilize its AC- 
3 (5.1ch) playback capability. 

[0006] However, not every content contains anAC-3 
(5,1ch) audio stream. Forexample, anAC-3 (5.1ch) au- 
diostreamiscertainly included in content of a recent hit 
movie, but may not be included in content of an old movie 
or an artfilm. If the status register automatic setting func- 
tion operates when playing content that does not include 
an AC-3 (5.1ch) audio stream, the playback apparatus 
will end up selecting a nonexistent audio stream. 
[0007] Conversely, it may be suggested to store, on a 
BD-ROM carrying an AC-3 (5.1 ch) audio stream, infor- 
mation for automatically selecting the AC-3 (5. 1 ch) audio 
stream. However, not every playback apparatus has an 
AC-3 (5.1ch) decoding capability. If the BD-ROM in- 



structs a playback apparatus without the AC-3 (5.1ch) 
decoding capability to select the AC-3 (5.1 ch) audio 
stream, a problem occurs. 

[0008] Thus, since not every content includes an AC- 
s 3 (5.1 ch) audio stream and not every playback apparatus 
has an AC-3 (5.1 ch) decoding capability, the user needs 
to set the status register in order to select an optimal 
audio stream at each playback session. A failure to do 
so often causes an AC-3 (5. 1 ch) audio stream to be wast- 
io ed without being played back. 

Disclosure of Invention 

[0009] The present invention aims to provide a play- 
's back apparatus that performs stream selection so as to 
make full use of advantages of both a recording medium 
and the playback apparatus. 

[0010] The stated aim can be achieved by a playback 
apparatus including: a judgment unit operable to judge, 

20 for each elementary stream, which of a plurality of pre- 
determined conditions the elementary stream satisfies; 
and a playback unit operable to assign a priority to each 
elementary stream according to a pattern of conditions 
theelementarystreamsatisfies, and select and play back 

25 a highest-priority elementary stream. 

[0011] Each elementary stream is assigned a priority 
depending on which of the plurality of conditions the el- 
ementary stream satisfies. The plurality of conditions re- 
late to a decoding capability of the playback apparatus, 

so a language setting of the playback apparatus, and a sur- 
round output capability of the playback apparatus. If an 
AC-3 (5.1ch) elementary stream included in the digital 
stream satisfies all of these conditions, the AC-3 (5.1ch) 
elementary stream is assigned a highest priority and se- 

35 lected for playback. If the playback apparatus does not 
have an AC-3 (5.1ch) playback capability, on the other 
hand, an elementary stream that is decodable by the 
playback apparatus and matches the language setting 
of the playback apparatus is selected for playback. 

40 [0012] Thus, a priority is assigned to each audio 
stream depending on which conditions the audio stream 
satisfies, and a highest-priority audio stream is selected 
for playback. This is a shift from a conventional idea of 
simply selecting a playable audio stream, to an idea of 

45 selecting such an audio stream that fully exploits the ca- 
pabilities of the playback apparatus. 

Brief Description of Drawings 

so [0013] 

FIG. 1 A shows an example of use of a playback ap- 
paratus to which the present invention relates. 
FIG. 1 B shows keys on a remote control 400 for re- 
55 ceiving a user operation on an Interactive Display. 
FIG. 2 shows a structure of a BD-ROM. 
FIG. 3 shows a representation of how an AV Clip is 
formed. 
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FIG. 4 shows a structure of Clio information. 
FIG. 5 shows a structure of PlayList information. 
FIG. 6 shows a representation of indirect referencing 
by PlayList information. 

FIG. 7 shows a representation of synchronization of s 
a SubPlayltem using a sync_Playltem„id and a 
synch _start_PTS_of_Play Item. 
FIG. 8 shows a structure of an STN_table. 
FIG. 9A shows an entry-attribute combination corre- 
sponding to a video stream. 10 
FIG. 9B shows an entry-attribute combination corre- 
sponding to an audio stream. 
FIG. 9C shows an entry-attribute combination cor- 
responding to a PG stream. 

FIG. 9D shows an entry-attribute combination cor- 15 
responding to textST stream. 
FIG. 9E shows an entry-attribute combination corre- 
sponding to an IG stream. 

FIG. 10 shows a structure of PlayList information 
preloaded on an HD. 20 
FIG. 11 shows file designation by 
Clipjnforniafion_file_names in the PlayList infor- 
mation on the HD. 

FIG. 12 shows an internal construction of the play- 
back apparatus to which the present invention re- 25 
lates. 

FIG. 13 shows detailed settings of PSR1, PSR2, 
PSR15, PSR16, and PSR30. 
FIG. 14 shows detailed settings of PSR4 to PSR8. 
FIG. 15A shows status transitions that can be made 30 
by PSR1. 

FIG. 1 5B is a flowchart of "Procedure when playback 

condition is changed" for PSR1. 

FIG. 1 6 is a flowchart of a detailed procedure of step 

S5. 35 

FIG. 1 7 shows combinations of playback capabilities 

and stream attributes in a tabular form. 

FIG. 18 shows audio stream selection based on an 

order of entries in an STN Jable. 

FIG. 1 9 is a flowchart of "Procedure when change is *> 

requested" for PSR1 . 

FIGS. 20A to 20C show a first specific example of 

audio stream selection according to "Procedure 

when playback condition is changed". 

FIGS. 21 A to 21C show a second specific example « 

of audio stream selection according to "Procedure 

when playback condition is changed". 

FIGS. 22A to 22C show a third specific example of 

audio stream selection according to "Procedure 

when playback condition is changed". so 

FIG. 23A shows status transitions that can be made 

by PSR2. 

FIG. 23B is a flowchart of "Procedure when playback 
condition is changed" for PSR2. 
FIG. 24 is a flowchart of "Procedure when change is ss 
requested" for PSR2. 

FIG. 25 is a flowchart of an operation of setting PSR2. 
FIGS. 26A to 26C show a specific example of 
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PGjextST_stream selection according to "Proce- 
dure when playback condition is changed". 
FIG. 27 shows PGJextST_stream selection based 
on an order of entries in an STN Jable. 
FIG. 28 shows a structure of PlayList information in 
a second embodiment of the present invention. 
FIG. 29 shows a file structure in the second embod- 
iment. 

FIGS. 30A and 30B show multi-angle and non-mul- 
ti-angle blocks. 

FIG. 31 shows detailed settings of PSR3. 

FIG. 32A shows status transitions that can be made 

by PSR3. 

FIG.32B isaflowchart of "Procedure when playback 
condition is changed" for PSR3. 
FIG. 32C is a flowchart of "Procedure when change 
is requested" for PSR3. 

FIGS. 33A and 33B show how angle blocks are se- 
lected. 

FIG. 34 shows an IG stream and an ICS in the IG 
stream. 

FIG. 35 shows a structure of buttonjnfo. 

FIG. 36 show a relationship between an ICS and 

ODSs in DSn. 

FIG. 37 shows overlaying performed with a presen- 
tation timing of picture data pt1 . 
FIG. 38 shows status transitions of Buttons 1-A to 
1-D. 

FIG. 39 shows an example of settings of buttonjnfo 
in an ICS. 

FIG. 40 shows display switchingfrom Page 1 to Page 

2. 

FIG. 41 shows detailed settings of PSRO, PSR10, 
andPSRn. 

FIG. 42A shows status transitions that can be made 
by PSRO. 

FIG. 42B is a flowchart of "Procedure when playback 
condition is changed" for PSRO. 
FIG. 43 is a flowchart of "Procedure when change is 
requested" for PSRO. 

FIG. 44 shows an internal structure of an Interactive 
Graphics Decoder 13. 

FIG. 45 is a flowchart of a synchronous control pro- 
cedure using time stamps. 

FIG. 46 is a flowchart of an initial display procedure. 
FIG. 47 is a flowchart of an auto-activation proce- 
dure. 

FIG. 48 is a flowchart of an animation display proce- 
dure. 

FIG. 49 is aflowchart of a button command execution 
procedure. 

FIG. 50 is a flowchart of an UO procedure. 

FIG. 51 is a flowchart of a current button switching 

procedure. 

FIG. 52 shows key operations performed by the user 
when viewing a drama series. 
FIG. 53 shows how Pages 1 to 4 shown in FIG. 52 
are assigned to a selection menu and a chapter 
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menu. 

FIG. 54 shows procedures defined by button com- 
mands to achieve focus shifts. 
FIG. 55 shows focus shifts performed according to 
focus positions on previous Pages. 
FIG. 56 shows bugs that can occur in focus shifts. 
FIG. 57A shows status transitions that can be made 
by PSR11. 

FIG.57B is a flowchart of "Procedure when playback 
condition is changed" for PSR1 1 . 
FIG. 57C is a flowchart of "Procedure when change 
is requested" for PSR1 1 . 

FIG. 58A shows status transitions that can be made 
by PSR10. 

FIG. 58B is a flowchart of "Procedure when playback 
condition is changed" for PSR1 0. 
FIG. 59 is a flowchart of "Procedure when change is 
requested" for PSR10. 

Best Mode for Carrying out the Invention 

First Embodiment 

[001 4] The following describes embodiments of a play- 
back apparatus to which the present invention relates. 
First, an example of an act of using the playback appa- 
ratus according to the present invention is explained. 
FIG. 1 shows an example of use of the playback appa- 
ratus according to the present invention. In the drawing, 
the playback apparatus according to the present inven- 
tion is a playback apparatus 200, which constitutes a 
home theater system together with a television 300 and 
a remote control 400. 

[0015] A BD-ROM 100 is used for providing a movie 
film in the home theater system that is constituted by the 
playback apparatus 200, the television 300, and the re- 
mote control 400. 

[0016] The remote control 400 receives a user opera- 
tion directed to the playback apparatus 200. FIG. 1B 
shows keys on the remote control 400 for receiving a 
user operation on an Interactive Display. As illustrated, 
the remote control 400 has a Move Up key, a Move Down 
key, a Move Right key, a Move Left key, an audio switch 
key for receiving an audio switching operation, a subtitle 
switch key for receiving a subtitle switching operation, 
and numeric keys "0" to "9". 

[0017] This concludes the description of the act of us- 
ing the playback apparatus according to the present in- 
vention. 

[0018] The BD-ROM which is a recording medium to 
be played back by the playback apparatus according to 
the present invention is described next. FIG. 2 shows a 
structure of the BD-ROM. In the drawing, the fourth level 
shows the BD-ROM, and the third level shows a track on 
the BD-ROM. The track is shown as being stretched out 
into a straight line, though in actuality the track spirals 
outwards from the center of the BD-ROM. The track in- 
cludes a lead-in area, a volume area, and a lead-out area. 
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The volume area has a layer model of a physical layer, 
a file system layer, and an application layer. The first 
level shows a format of the application layer (application 
format) of the BD-ROM in a directory structure. As illus- 
s trated, the BD-ROM has a BDMV directory below a 
ROOT directory. The BDMV directory contains files such 
as YYY.MPLS, XXX. CLPI, XXX.M2TS, ZZZ.M2TS, and 
ZZZ.CLPI. The XXX.M2TS file corresponds to an AV 
Clip, and the XXX. CLPI file corresponds to Clip informa- 

[0019] The recording medium according to the present 
invention can be realized by generating such an applica- 
tion format. 

is <Structure of the AV Clip> 

[0020] The AV Clip which is one of the components 
(AV Clip and Clip information) of content of the movie 
film is described below. 
20 [0021] FIG. 3 shows a representation of how the AV 
Clip is formed. 

[0022] The AV Clip (middle level) can be created as 
follows. A video streammade up of a plurality of video 
frames (pictures pj1, pj 2, pj3, ...) and an audio stream 

25 made up of a plurality of audio frames (upper first level) 
are each converted to PES packets (uppersecond level), 
and further converted to TS packets (upper third level). 
Likewise, a Presentation graphics stream (PG stream) 
for subtitles and an Interactive graphic stream (IG 

30 stream) for Interactive Displays (lowerfirst level) are con- 
verted to PES packets (lower second level), and further 
converted to TS packets (lower third level). These TS 
packets of the video, audio, and PG and IG streams are 
then multiplexed to form the AV Clip. 

35 [0023] Here, notonlythe PG stream multiplexed in the 
AV Clip but also a textST stream forms subtitles. The 
textST stream is a data string that represents subtitles 
by text data. The textST stream is called a subClip, and 
is recorded on the BD-ROM or an HD in the playback 

to apparatus by a filename different from that of the AV Clip. 
The PG stream and the textST stream which form sub- 
titles are both called a PG_textST_stream. This con- 
cludes the description of the AV Clip. 

45 <Structure of the Clip lnformation> 

[0024] The following describes the XXX.CLPI file. 
[0025] The Clip information (XXX.CLPI) is manage- 
ment information for the individual AV Clip. FIG. 4 shows 

so a structure of the Clip information. Dotted guidelines in 
the drawing indicate the structure of the Clip information 
in more detail. As indicated by guideline hn1, the Clip 
information (XXX.CLPI) includes Program. Info and an 
EP_map used for searching the video stream for a start 

55 of an I picture. 

[0026] The Program. Info is information showing a PID 
and an attribute of each individual elementary stream 
multiplexed in the AV Clip, in association with a 
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Streamjndex. The Stream., index is an index of each 
individual elementary stream multiplexed in the AV Clip 
corresponding to this Clip information. PIDs of the indi- 
vidual elementary streams identified by Streamjndices 
are shown in Stream J=ID [Streamjndex] entries indi- s 
cated by guideline hn2. 

[0027] Also, attributes of the individual elementary 
streams identified by the Streamjndices are shown in 
Stream_Attribute [Streamjndex] entries indicated by 
guideline hn3. The attributes include video attributes, au- 10 
dio attributes, and graphics attributes. The video at- 
tributes show a method used for compressing a video 
stream (Coding), a resolution of picture data which com- 
poses the video stream (Resolution), an aspect ratio of 
the picture data (Aspect) .aframerateofthepicturedata « 
(Framerate) , and the like. The audio attributes show a 
method usedforcompressing an audio stream (Coding), 
a channel attribute of the audio stream (Ch.), a language 
attribute of the audio stream (Lang) , and the like . 
Through the use of a stream index, an attribute of an 20 
elementarystreamcanberetrievedfromthe Program In- 
fo. 

[0028] The EP_map is a reference table for indirect 
referencing of addresses of a plurality of locations to 
which a skip operation is likely to be made, using time 25 
information. As indicated by guideline hn5, the EP_map 
includes a plurality of entries (ACCESS UNIT #1 entry, 
ACCESS UNIT #2 entry, ACCESS UNIT #3 entry, ...) 
and the number of entries (Number) . 
[0029] As indicated by guideline hn6, each of the en- 30 
tries shows a playback start time of a corresponding I 
picture, together with an address of the I picture and a 
size of the I picture (l-Size). The playback start time of 
the I picture is expressed using a time stamp (Presenta- 
tion Time Stamp) of the I picture. The address of the I 35 
picture is expressed using a serial number (SPN (Source 
Packet Number)) of a TS packet corresponding to the I 
picture. It should be noted here that the filename XXX of 
the Clip information XXX.CLPI is the same as the filena- 
me of the AV Clip corresponding to the Clip information. *o 
Which is to say, the filename XXX of the Clip information 
in FIG. 4 means the Clip information corresponds to the 
AV Clip XXX. M2TS . This concludes the description of 
the Clip information. 

<ZZZ.M2TS and ZZZ.CLPI> 

[0030] The following describes the ZZZ.M2TS f ile and 
the ZZZ.CLPI file. The subClip (ZZZ.M2TS) is a file stor- 
ing a stream that is played synchronously with the AV so 
Clip. A representative of such a subClip is the aforemen- 
tioned textST stream. Other subClips include an audio 
stream and an IG stream. The AV Clip shown in FIG. 3 
is hereafter also called a main Clip, to distinguish it from 
the subClip. 55 
[0031] The Clip information (ZZZ.CLPI) is Clip infor- 
mation corresponding to the subClip. 



<Structure of the PlayList information> 

[0032] The following describes the YYY.MPLS file. 
The PlayList information (YYY.MPLS) is information 
which defines a combination of two types of playback 
paths that are a main path and a SubPath, as a PlayList 
(PL). FIG. 5 shows a data structure of the PlayList infor- 
mation. As shown in the drawing, the PlayList information 
includes Playltem information #1 , #2, ... ,#m for defining 

the main path and SubPath information #1, #2 #p 

each for defining the SubPath. 

[0033] The main path is a playback path defined on an 
AV Clip which is the main Clip, whereas the SubPath is 
a playback path defined on a subClip. 
[0034] The main path is explained first The main path 
is defined by a plurality of sets of Playltem information 
(Play Item information #1, #2, #3, ... ,#m) and the number 
of sets of Playltem information (Number) . Playltem in- 
formation defines at least one logical playback section 
included in the main path. Guideline hs1 indicates a de- 
tailed structure of the Playltem information. As illustrated, 
the Playltem information includes a 
Clip lnformationJile_name field showing a filename of 
Clip information of the AV Clip to which an IN point and 
an OUT point of the playback section belong, a 
Clip_codecJdentifier field showing a coding method of 
the AV Clip, an INJime field which is time information 
indicating a start of the playback section, an OUTjime 
field which is time information indicating an end of the 
playback section, and an STNjable field showing, 
among the elementary streams in the AV Clip and its 
related subClip, elementary streams from which the play- 
back apparatus can select for presentation of the Play- 
ltem. 

[0035] The Playltem information has a feature of being 
written based on conversion from time information to an 
addresses. In other words, the playback section is de- 
fined in the form of indirect referencing that uses the 
EP_map as a reference table. FIG. 6 shows a represen- 
tation of indirect referencing by PlayList information. In 
the drawing, the AV Clip is composed of a plurality of TS 
packets. The EP ..map in the Clip information specifies 
sector addresses of TS packets that correspond to starts 
of I pictures, as indicated by arrowsayl , ay2, ay3, ay4, .... 
Arrows jyl, jy2, jy3, jy4, ... indicate a representation of 
referencing of TS packets by Playltem information. It can 
be understood from the drawing that the referencing by 
the Playltem information (indicated by arrows jyl , jy2, 
jy3, jy4, ...) is indirect referencing that specifies address- 
es of TS packets in the AV Clip through the EPjnap. 
[0036] A playback section on the BD-ROM, which is 
obtained by a combination of Playltem information, Clip 
information, and an AV Clip, is called a Playltem. The 
movie film recorded on the BD-ROM is composed of Play- 
Items. Since the movie film recorded on the BD-ROM is 
composed of logical playback units, "sharing", i.e. an AV 
Clip which forms a scene of one movie filmbeing refer- 
enced by another movie film, can be efficiently conduct- 
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ed. 

[0037] The variation in movie films can be widened just 
by defining various kinds of PlayList information, which 
enables movie film producers to extend the range of ex- 
pression. This is a greatest advantage of static scenario. 
Playback units of BD-ROMs include not only a Playltem 
but also a Title and a Chapter. The Title is a playback 
unit corresponding to one movie film, and is composed 
of at least one set of PlayList information. The Chapter 
is a playback unit corresponding to one chapter of a mov- 
ie film, and is defined by information called Mark infor- 

[0038] The filename YYY of the PlayList information 
represents a three-digit ID number assigned to the Play- 
List information in the BD-ROM . Which is to say, the Play- 
List information shown in FIG. 6 is uniquely identified by 
this ID number YYY. The use of "YYY" as the ID number 
of the PlayList information indicates that the ID number 
of the PlayList information has a different numbering sys- 
tem from the ID number XXX of the AV Clip and the Clip 
information (though the number of digits of the I D number 
is three in this example, the numberof digits is not limited 
to such). 

[0039] This concludes the description of the main path. 
The SubPath is described next. 

<SubPath> 

[0040] Guideline hc1 in FIG. 5 indicates a structure of 
SubPath information in detail. As illustrated, the SubPath 
information is made up of at least one set of SubPlayl tern 
information. SubPlayltem information includes a 
ClipJnformation_file_name field, a Clip_codecJdenti- 
fier field, a SubPlayltemJNJime field, a SubPlayltem_ 
OUT_time field, a sync_Playltem_id field, and a 
sync_start_PTS_of_Playltem field, as indicated by 
guideline hc2. 

[0041] The Clip_lnformation_file_name field shows a 
filename of Clip information of a subClip corresponding 
to the SubPlayltem, to thereby uniquely identify the sub- 
Clip. 

[0042] The Clip_codec_identifierfield shows a coding 
method of the subClip. 

[0043] The SubPlayltem_IN_time field is time informa- 
tion indicating a start of the SubPlayltem on a playback 
time axis of the subClip. 

[0044] The SubPlayltem. OUT Jime field is time infor- 
mation indicating an end cf the SubPlayltem on the play- 
back time axis of the subClip. 

[0045] The sync_Playltem_id field uniquely identifies 
one of the Playltems in the main path with which the 
SubPlayltem is to be synchronized. The SubPlayltem_ 
IN Jime is present on aplaybacktime axis of the Playltem 
identified by the sync_Playltem_id. 
[0046] The sync_start_PTS_of_Playltem field speci- 
fies the start of tne SubPlayltem indicated by the 
SubPlayltemJNJime, on the playback time axis of the 
Playltem identified by the sync_Playltem_id. When the 



current playback time has reached a point specified by 
this sync_start_PTS_of_Playltem on the playback time 
axis of the Playltem, the playback of the SubPlayltem is 
launched. 

s [0047] FIG. 7 shows a representation of synchroniza- 
tion of the SubPlayltem according to the sync_Playltem_ 
id and the sync_start_PTS_of_Play Item. I n the drawing, 
the main path is made up of Playltems #1 , #2, and #3. 
The sync_Playltem_id and the sync_start_PTS_of_ 

io Playltem of the SubPlayltem which forms a SubPath are 
set as shown in dotted box wh1. In detail, the 
sync_Playltem_id is set to specify Playltem #1 , and the 
sync_start_PTS_of_Playltem is set to specify time t1 on 
the playback time axis of Playltem #1. This being the 

15 case, when the current playback time has reached t1 on 
the playback time axis of Playltem #1 , playback of a part 
of the subClip (textST stream), specified by the 
Clip_lnformation_file_name, from the SubPlayltem_IN_ 
time to the SubPlayltem OUTJime is launched. As a 

20 result, the part of the textST stream from the 
SubPlayltem_IN_time to the SubPlayltem_OUT_time is 
played synchronously with the AV Clip. This concludes 
the description of the SubPath information. 
[0048] The STNJable field included in the Playltem 

25 information described above provides information used 
for status settings, and is an essential feature of the 
present invention. The following describes the 
STNJable in detail. 

30 <STN_table> 

[0049] The STNJable shows elementary streams 
available for presentation, among elementary streams 
multiplexed in the AV Clip specified by the Clip_ 

as informationJile_name of the Playltem and elementary 
streams in a subClip specified by the Clip_ 
lnformation_file_name of a SubPlayltem relating to the 
Playltem. The STNJable is formed by associating an 
entry of each elementary stream with its attribute. An 

40 elementary stream available for presentation is mainly 
an elementary stream multiplexed in the AV Clip speci- 
fied by the Playltem, but may also include an elementary 
stream (textST stream) recorded separately from the AV 
Clip but played together with the AV Clip. 

45 [0050] FIG. 8 shows a structure of the STNJable. As 
shown in the drawing, the STNJable includes a plurality 
of combinations of entries and attributes (entry-attribute), 
and the numbers of entry-attribute combinations 
(number_of_video_stream_entries, 

so number_of_audio_stream_entries, 

number_of_PGJextST_stream_entries, and 
number_ofJG_stream_entries) . 
[0051] The entry-attribute combinations correspond to 
a video stream, audio streams, PGJextST_streams, and 

55 |G streams that are available for presentation in the Play- 
ltem, as indicated by the parenthesis "{". 
[0052] The entry-attribute combinations are explained 
in detail below. FIGS. 9A to 9D show the entry-attribute 
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combinations in detail. 
[0053] FIG. 9A shows an entry-attribute combination 
corresponding to a video stream. 
[0054] An entry in this en try- attribute combination cor- 
responding to the video stream includes a refJo_ 
strearn_PID_of jnainClip field showing a PID used for 
extracting the video stream when demultiplexing the AV 
Clip. 

[0055] An attribute in the entry-attribute combination 
corresponding to the video stream includes a stream,, 
codingjype field which is set to 0x02, and aframejate 
field showing a display rate of the video stream. 
[0056] FIG. 9B shows an entry-attribute combination 
corresponding to an audio stream. 
[0057] An entry in the entry-attribute combination cor- 
responding to the audio stream includes a ref_to_ 
stream_PID_of_mainClip field showing a PID used for 
extracting the audio stream when demultiplexing the AV 
Clip. 

[0058] An attribute in the entry-attribute combination 
corresponding to the audio stream includes a stream„ 
codingjype field which is set to one of 0x80 (Linear 
PCM) ,0x81 (AC-3), and 0x82 (DTS) to indicate a coding 
type of the audio stream, an audio jresentationjype 
field showinga channel structu re of the audio stream and 
indicating whether surround output is possible, and an 
audiojanguage jodefield showing a language attribute 
of the audio stream. 

[0059] FIG, 9C shows an entry-attribute combination 
corresponding to a PG stream. 
[0060] An entry in the entry-attribute combination cor- 
responding to the PG stream includes a ref_to_ 
stream_PID_of_mainClip field showing a PiD used for 
extracting the PG stream when demultiplexing the AV 
Clip. 

[0061] An attribute in the entry-attribute combination 
corresponding to the PG stream includes a strearn_ 
codingjype field which is set to 0x90 indicating a PG 
stream codec, and a PGJanguage_code field showing 
a language attribute of the PG stream. 
[0062] FIG. 9D shows an entry-attribute combination 
corresponding to a textST stream. 
[0063] An entry in the entry-attribute combination cor- 
responding to the textST stream includes a ref_to_ 
subClip ._entry_id field showing an entry identifier of a 
subClip storing the textST stream, a ref_to_SubPath_id 
field showing an ID of SubPath information, and a 

ref_to_stream_PID of_subClip field showing a PID of 

the textST stream. 

[0064] An attribute in the entry-attribute combination 
corresponding to the textST stream includes a stream_ 
codingjype field which is set to 0x92 indicating a textST 
stream codec, a character jode field showing a charac- 
ter code of the textST stream, and a textST_ 
language jode field showing a language attribute of the 
textST stream. 

[0065] FIG. 9E shows an entry-attribute combination 
corresponding to an IG stream. 
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[0066] An entry in the entry-attribute combination cor- 
responding to the IG stream includes a refJo_ 
stream_PID„of_mainClip field showing a PID used for 
extracting the IG stream when demultiplexing the AV 

5 Clip. 

[0067] An attribute in the entry-attribute combination 
corresponding to the IG stream includes a stream,, 
codingjype field which is set to 0x91 indicating an IG 
stream codec, and an IGJanguagejode field showing 

?o a language attribute of the IG stream. This concludes the 
description of the data structure of the entry-attribute 
combination of each elementary stream. The order of 
entries in the STNJable is interpreted as the order of 
priorities in stream selection. Also, entries of textST 

is streams and PG streams are put in one group in the 
STNJable in orderto treat the PG streams and the textST 
streams on an equal basis and determine which stream 
out of the PG streams and the textST streams has a 
higher priority. For example, if a textST stream has a 

zo higher entry than a PG stream in the group of entries for 
PGjextST_st reams in the STNJable, the textST stream 
is selected over the PG stream. Conversely, if the PG 
stream has a higher entry than the textST stream in the 
STNJable, the PG stream is selected over the textST 

25 stream. 

[0068] The above STNJable is provided for each set 
of PlayList information. Therefore, there may be a case 
where an entry of one elementary stream is high in an 
STNJable of one set of PlayList information but low in 
so an STNJable of another set of PlayList information. 
[0069] This concludes the description of the data struc- 
ture of the application format in the BD-ROM. It should 
be noted here that the recording medium to be played 
back by the playback apparatus according to the present 
35 invention is not limited to the BD-ROM, but also includes 
the HD in the playback apparatus. Data recorded on the 
HD is explained below. The HD stores a file containing 
a subClip, a file containing Clip information, and a file 
containing PlayList information, too. These files are 
4° preloaded onto the HD via a network. FIG. 10 shows a 
structure of such preloaded PlayList information. As 
shown in the drawing, the preloaded PlayList information 
has a similar structure to the PlayList information on the 
BD-ROM shown in FIG. 5. The difference from the one 
45 shown in FIG. 5 lies in that a Clipjnformation Jile_name 
in Playltem information and a ClipJnfcrmation_ 
file.„name in SubPlayltem information can each desig- 
nate Clip information on any of the BD-ROM and the HD. 
To designate Clip information on the BD-ROM, afull path 
so of afileonthe BD-ROM needs not be used in the preload- 
ed PlayList information. This is because the playback 
apparatus recognizes the BD-ROM and the HD together 
as one virtual drive (called a virtual package). Accord- 
ingly, a Clipjnformation Jilejame in Playltem informa- 
55 tion and a Clipjnformation Jilejame in SubPlayltem 
information in the preloaded PlayList information can 
designate an AV Clip on any of the HD and BD-ROM, by 
using a file body, such as XXX or ZZZ, of a file containing 
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Clip information. FIG. 11 shows designation of files by 
ClipJnformationJile_names in PlayList information on 
the HD. In the drawing, arrows rf1, rf2, and rf3 indicate 
file designation by Clip_lnformation_file_names in Play- 
Item information in the PlayList information, and arrows 
pf1, pf2, and pf3 indicate file designation by Clip_ 
lnformation_file_names in SubPlayltem information in 
the PlayList information. Through such file designation 
by ClipJnformation_file_names, a SubPath defined on 
a subClip on the HD can be played synchronously with 
a main path defined on a main Clip on the BD-ROM. 
[0070] Note that the data structures explained above 
are instances of class structures written in a program- 
ming language. The author writes the class structures to 
create these data structures on the BD-ROM. 
[0071 J This concludes the description of the recording 
medium. Thefollowing describes the playback apparatus 
according to the present invention. FIG. 12 shows an 
internal construction of the playback apparatus accord- 
ing to the present invention. The playback apparatus ac- 
cording to the present invention is manufactured based 
on this internal construction. The playback apparatus is 
roughly made up of two parts that are a system LSI and 
a drive device. The playback apparatus can be manu- 
factured by mounting these parts on a cabinet and sub- 
strate of the apparatus. The system LSI is an integrated 
circuit including various processing units for achieving 
the functions of the playback apparatus. The playback 
apparatus includes a BD drive 1 , a Read Buffer 2, a De- 
multiplexer 3, a Video Decoder 4, a Video Plane 5, a 
Presentation Graphics Decoder 9, a Presentation Graph- 
ics Plane 10, an adder 11, a Font Generator 12, an In- 
teractive Graphics Decoder 13, a switch 14, an Interac- 
tive Graphics Plane 1 5, an adder 1 6, an HDD 1 7, a Read 
Buffer 18, a Demultiplexer 19, an Audio Decoder 20, a 
scenario memory 23, a control unit 24, a switch 25, a 
CLUT unit 26, a CLUT unit 27, a PSR set 28, and an 
operation reception unit 29. The control unit 24 includes 
a transition control unit 30. 

[0072] The BD drive 1 performs loading and ejecting 
of the BD-ROM, and accesses to the BD-ROM. 
[0073] The Read Buffer 2 is a FIFO memory. Accord- 
ingly, TS packets read from the BD-ROM are removed 
from the Read Buffer 2 in a same order as they arrive. 
[0074] The Demultiplexer (Demux) 3 reads TS packets 
from the Read Buffer 2 and converts the TS packets to 
PES packets. The Demultiplexers outputs PES packets 
having a stream ID designated by the control unit 24 to 
one of the Video Decoder 4, the Audio Decoder 20, the 
Presentation Graphics Decoder 9, and the Interactive 
Graphics Decoder 13. 

[0075] The Video Decoder 4 decodes PES packets 
output from the Demultiplexer 3 to obtain uncompressed 
pictures, and writes the uncompressed pictures to the 
Video Plane 5. 

[0076] The Video Plane 5 is a plane for storing uncom- 
pressed pictures. Here, a plane is a memory area used 
for storing one screen of pixel data in the playback ap- 
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paratus. By providing the playback apparatus with a plu- 
rality of planes and adding the storage contents of these 
planesforcorresponding pixels, an imageoutputin which 
a plurality of images are overlaid on each other can be 

5 produced. The Video Plane 5 has a resolution of 1920 
x 1080, and picture data stored on the Video Plane 5 is 
composed of pixel data expressed by 1 6-bit YUV values. 
[0077] The Presentation Graphics Decoder 9 decodes 
a graphics stream read from the BD-ROM or the HD to 

io obtain uncompressed graphics, and writes the uncom- 
pressed graphics to the Presentation Graphics Plane 10. 
As a result of decoding the graphics stream, subtitles are 
displayed on the screen. 

[0078] The Presentation Graphics Plane 1 0 is amem- 
15 ory having one screen of area, and is capable of storing 
one screen of uncompressed graphics. The Presentation 
Graphics Plane 1 0 has a resolution of 1920 x 1080, and 
each pixel in the uncompressed graphics on the Presen- 
tation Graphics Plane 10 is expressed by an 8-bit index 
20 color. By converting the index color using a CLUT (Color 
Lookup Table), the uncompressed graphics on the Pres- 
entation Graphics Plane 10 is presented for display. 
[0079] The adder 1 1 overlays the storage contents of 
the Presentation Graphics Plane 10 on uncompressed 
25 picture data (i) . 

[0080] The Font Generator 12 develops text code in- 
cluded in a textST stream to a bitmap, using a character 
font. 

[0081] The Interactive Graphics Decoder 13 decodes 

30 an IG stream read from the BD-ROM or the HD to obtain 
uncompressed graphics, and writes the uncompressed 
graphics to the Interactive Graphics Plane 15. 
[0082] The switch 14 selectively writes one of a font 
string generated by the Font Generator 12 and graphics 

35 generated by the Presentation Graphics Decoder 9, to 
the Presentation Graphics Plane 10. 
[0083] The Interactive Graphics Plane 15 is used for 
storing uncompressed graphics obtained by the Interac- 
tive Graphics Decoder 13. 

to [0084] The adder 1 6 overlays the storage contents of 
the Interactive Graphics Plane 15, on picture data (ii) 
which is generated by overlaying the storage contents of 
the Presentation Graphics Plane 10 on the uncom- 
pressed picture data (i). 

is [0085] The HDD 1 7 is the aforementioned HD included 
in the playback apparatus. By reading the storage con- 
tents of the HDD 17 and dynamically combining them 
with the storage contents of the BD-ROM, a graphics 
stream or a textST streamnot recorded on the BD-ROM 

50 can be presented. 

[0086] The Read Buffer 1 8 is a FIFO memory. Accord- 
ingly, TS packets read from the HDD 17 are removed 
from the Read Buffer 1 8 in the same order as they arrive. 
[0087] The Demultiplexer (Demux) 1 9 reads TS pack- 

55 ets from the Read Buffer 18 and converts the TS packets 
to PES packets. The Demultiplexer 1 9 outputs PES pack- 
ets having a stream ID designated by the control unit 24, 
to the Font Generator 1 2. 
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[0088] The Audio Decoder 20 decodes PES packets 
output from the Demultiplexer 3, and outputs uncom- 
pressed audio data. 

[0089] The scenario memory 23 is used forstoring cur- 
rent PlayList information and current Clip information, s 
The current PlayList information refers to PlayList infor- 
mation that relates to the current playback, among a plu- 
rality of sets of PlayList information recorded on the 
BD-ROM. The current Clip information refers to Clip in- 
formation that relates to the current playback, among a 10 
plurality of sets of Clip information recorded on the 
BD-ROM. 

[0090] The control unit 24 controls reading of an AV 
Clip from the BD-ROM and playback of the AV Clip, ac- 
cordingtothecurrent PlayList information andthecurrent is 
Clip information on the scenario memory 23. In detail, 
the control unit 24 detects the current Playltem in the 
current PlayList information. With reference to the current 
Clip information identified by a Clip Information 
file name of the current Playltem, the control unit24 con- so 
trols the BD-ROM drive 1 to read TS packets from an 
INjime to an OUTjime of the current Playltem, from an 
AV Clip specified by the current Clip information. The 
read TS packets are output selectively to the Video De- 
coder 4, the Presentation Graphics Decoder 9, the Inter- ss 
active Graphics Decoder 13, and the Audio Decoder 20 
via the Demultiplexer 3, to play the AV Clip. 
[0091] If the current PlayList information includes a 
SubPlayltem to be synchronized with the current Play- 
ltem, the control unit 24 plays a subClip specif iedby the 3o 
SubPlayltem synchronously with the main Clip. This syn- 
chronization is conducted by playing back data from a 
SubPlayltemJN_time to a SubPlayltem_OUT_tlme of 
the SubPlayltem when picture data corresponding to a 
sync_start_PTS_of Playltem of the SubPlayltem is read as 
from the main Clip. 

[0092] The switch 25 selectively feeds various data 
read from the BD-ROM and the HD to the Read Buffer 
2, the Read Buffer 18, and the scenario memory 23. 
[0093] The CLUT unit 26 converts index colors of the 40 
uncompressed grapnics stored on the Video Plane 5, to 
Y, Cr, and Cb values. 

[0094] The CLUT unit 27 converts index colors of the 
uncompressed graphics stored on the Interactive Graph- 
ics Plane 1 5, to Y, Cr, and Cb values. 45 
[0095] The PSR set 28 is a register equipped in the 
playback apparatus, and is composed of 64 Player Status 
Registers (PSRs) and 4096 General Purpose Registers 
(GPRs). A definition of a value of each PSR will be ex- 
plained in detail later. so 
[0096] The operation reception unit 29 outputs, when 
an operation of selecting a stream or the like is made on 
the remote control or a front panel of the playback appa- 
ratus, useroperation information indicating the operation 
to the control unit 24. 55 
[0097] The transition control unit 30 is included in the 
control unit 24. The transition control unit 30 extracts a 
stream_PID of an entry- attribute combination corre- 



spondingtoaPSRfrom an STNjableinthecurrent Play- 
ltem information, and outputs the extracted stream__PID 
to the Demultiplexer 3 or 19. Since the setting of the 
Stream_.PID in the Demultiplexer 3 or 1 9 is based on the 
PSR, the transition control unit 30 performs a setting op- 
eration on the PSR in accordance with a condition change 
in or a change request to the playback apparatus. 
[0098] In detail, when a condition change occurs in the 
playback apparatus, the transition control unit 30 judges 
whether a value of the PSR is Valid, Invalid, or undefined. 
If the value is Valid, the transition control unit 30 maintains 
the value. If the value is Invalid or undefined, the transition 
control unit 30 sets an optimal value in the PSR. 
[0099] When achange of the PSR is requested by user 
operation information outputfrom the operation reception 
unit 29 or a button command output from the Interactive 
Graphics Decoder 13, the transition control unit 30 de- 
termines a value (value X) to be set in the PSR according 
to the user operation information orthe button command, 
and performs a PSR update operation based on value 
X. If the useroperation information indicates that the au- 
dio switch key orthe subtitle switch keyhas been pressed, 
the transition control unit 30 determines a sum of the 
PSR and 1 as value X. If the user operation information 
indicates that one of the numeric keys has been pressed, 
the transition control unit 30 determines a number cor- 
responding to the pressed numeric key as value X. If the 
button command instructs to set the PSR, on the other 
hand, the transition control unit 30 determines a value 
specified by an argument of the button command as value 
X. Once value X has been determined in this way, the 
transition control unit 30 judges whether value X is Valid, 
Invalid, or undefined, and performs a PSR update oper- 
ation depending on a result of the judgment. In detail, if 
value X is Valid, the transition control unit 30 overwrites 
the PSR with value X. If value X is undefined, the transi- 
tion control unit 30 selects an optimal value and sets the 
optimal value in the PSR. If value X is Invalid, the tran- 
sition control unit 30 maintains the value of the PSR. 

<PSRs> 

[OIOO] This concludes the description of the construc- 
tion of the playback apparatus according to the present 
invention. The following describes individual PSRs in the 
PSR set 28. In the PSR set 28, PSR1, PSR2, PSR15, 
PSR 1 6, and PSR30 relate to selection of audio and sub- 
titles, capabilities of decoding and presenting audio and 
subtitles, and a language setting in the playback appa- 
ratus. FIG. 13 shows detailed settings of PSR1 . PSR2, 
PSR15, PSR16, and PSR30. 

[0101] PSR1 specifies an audio stream currently se- 
lected by the playback apparatus. 
[0102] PSR2 includes a dispjlag field, and specifies 
a PG_textST_stream currently selected by the playback 
apparatus. The dispjlag field is set to 0 to indicate that 
display of a PG stream and a textST stream is disabled, 
and 1 to indicate that display of a PG stream and a textST 
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stream is enabled. 

[0103] PSR15 includes an LPCM capability field, an 
AC-3 capability field, and a DTS capability field. The 
LPCM capability field is set to 0001 b to indicate that the 
playback apparatus is capable of playing LPCM stereo, 
and 001 0 b to indicate that the playback apparatus is ca- 
pable of playing LPCM surround. 
[01 04] The AC-3 capability field is set to 0001 b to in- 
dicate that the playback apparatus is capable of playing 
AC-3 stereo, and 001 0 b to indicate that the playback ap- 
paratus is capable of playing AC-3 surround. 
[0105] The DTS capability field is set to 0001 b to indi- 
cate that the playback apparatus is capable of playing 
DTS stereo, 001 0 b to indicate that the playback appara- 
tus is capable of playing DTS surround, and 0000 b to 
indicate that the playback apparatus is incapable of de- 
coding a DTS audio stream. 

[0106] PSR16 is set to a value other than OxFFF to 
indicate an audio stream language attribute, and set to 
OxFFF to indicate that no audio stream language attribute 
is specified. 

[0107] A most significant bit of PSR30 is set to 0 to 
indicate that the playback apparatus is incapable of dis- 
playing text subtitles, and set to 1 to indicate that the 
playback apparatus is capable of displaying text subtitles. 
[0108] This concludes the explanation of FIG. 13. The 
following describes PSR4 to PSR8with reference to FIG. 
14. FIG. 14 shows detailed settings of PSR4 to PSR8. 
[0109] PSR4 is set to one of the values 1 to 100 to 
indicate a number of a Title corresponding to the current 
playback time, and set to 0 to indicate that the current 
playback time corresponds to a top menu. 
[0110] PSR5 is set to one of the values 1 to 999 to 
indicate a number of a Chapter corresponding to the cur- 
rent playback time, and set to OxFFFF to indicate that a 
Chapter numoer is nvalid in the playback apparatus. 
[0111] PSR6 is set to one of the values 0 to 999 to 
indicate a number of a PlayList corresponding to the cur- 
rent playback time (current PlayList). 
[0112] PSR7 is set to one of the values 0 to 255 to 
indicate a number of a Playltem corresponding to the 
current playback time (current Playltem). 
[0113] PSR8 is set to one of the values 0 to 
OxFFFFFFFF to indicate the current playback time with 
a time accuracy of 45 KHz (current PTM). This concludes 
the explanation of PSR4 to PSR8. 

<Status transitions of PSR1> 

[0114] The following describes status transitions of 
PSR1 in detail. 

[0115] PSR1 specifies one of a plurality of audio 
streams which are listed as entries in the STN Jable of 
the current Playltem. When PSR1 changes, the playback 
apparatus plays back an audio stream specified by the 
changed PSR1. PSR1 is initially set to OxFF, andean be 
reset to any of the values 1 to 32 by the playback appa- 
ratus. The value OxFF is an undefined value, indicating 



that no audio stream is present or no audio stream is 
selected. The values 1 to 32 are interpreted as audio 
stream numbers. 

[0116] FIG. 15A shows status transitions that can be 
5 made by PSR1 . In the drawing, the term "Valid" denotes 
a state where PSR1 is no greater than the number of 
entries in the STNJable of the current Playltem and also 
the playback apparatus is capable of playing the audio 

10 [0117] Meanwhile, the term "Invalid" denotes a state 
where PSR1 is 0 or greater than the number of entries 
in the STN Jable of the current Playltem. There may be 
acase where even if PSR1 is no greaterthan the number 
of entries in the STNJable of the current Playltem, the 

w playback apparatus is incapable of decoding the audio 
stream. 

[0118] Procedures forsettingPSRl upon a status tran- 
sition are schematically shown in dotted boxes in FIG. 
15A. There are two types of PSR setting procedures, 
20 namely, "Procedure when playback condition is 
changed" and "Procedure when change is requested". 
[0119] "Procedure when playback condition is 
changed" is a procedure to run when the condition of the 
playback apparatus changes due to the occurrence of 
25 some kind of event. 

[0120] "Procedure when YYY change is requested" is 
a procedure to run when the user requests some kind of 
change (stream change in the case of FIG. 15). 
[0121] "Procedure when playback condition is 
30 changed" and "Procedure when change is requested" 
shown in the dotted boxes are the stream selection pro- 
cedures that constitute the principal features of the 
present invention, and will be explained in detail later with 
reference to flowcharts. 
35 [0122] Each arrow in FIG. 15A represents a status 
transition of PSR1 . 

[0123] A comment accompanying each arrow denotes 
an event which triggers a status transition. In detail, when 
any of "Load a disc", " Change a Stream", "Start PlayList 
40 playback", "Cross a Playltem boundary", and "Terminate 
PlayList playback" occurs, PSR1 undergoes a status 
transition. In view of this notation, it can be understood 
from FIG. 15A that none of the above procedures is per- 
formed upon a status transition from Invalid to Invalid and 
45 astatustransitionfromValidto Invalid. Ontheotherhand, 
each of a status transition from Invalid to Valid and a 
status transition from Valid to Valid passes one of the 
procedures, in other words, to set Valid PSR1, "Proce- 
dure when playback condition is changed" or "Procedure 
so when change is requested" is carried out. 

[0124] The events which trigger status transitions are 
explained below. 

[0125] "Load a disc" is an event of loading the BD-ROM 
to the playback apparatus. Upon loading, PSR1 is initially 
55 set to an undefined value (OxFF). 

[0126] "Start PlayList playback" is an event of starting 
playback based on a PlayList. When this event occurs, 
"Procedure when playback condition is changed" is per- 
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formed, and PSR1 becomes Valid. 
[0127] "Terminate PlayList playback" is an event of 
ending playback based on a PlayList. When this event 
occurs, "Procedure when playback condition is changed" 
is not performed, and PSR1 becomes Invalid. s 
[0128] "Change XXX" is an event of receiving a user 
request to switch XXX (stream in the case of FIG. 15) . 
When this event occurs while PSR1 is lnvalid(Cj1 in FIG. 
15A) , PSR1 issetto a value requested by the user. Even 
if this set value shows a valid audio stream number, PSR1 «> 
is treated as Invalid. Thus, a PSR which is Invalid never 
changes to Valid by "Change XXX". 
[0129] When "Change a Stream" occurs while PSR1 
is Valid (Cj2) , on the other hand, "Procedure when 
change is requested" is performed and a new value is is 
assigned to PSR1. The value assigned to PSR1 here 
may not be the value requested by the user. This is be- 
cause "Procedure when change is requested" has afu no- 
tion of excluding an invalid value. PSR1 which is Valid 
never changes to Invalid by "Change a Stream", since 20 
"Procedure when change is requested" ensures not to 
make PSR1 Invalid. 

[0130] "Cross a Playltem boundary" is an event where 
playback crosses over a Playltem boundary. The Play- 
ltem boundary refers to here is a point between an end 25 
of one Playltem and a beginning of an immediately suc- 
ceeding Playltem. When this event occurs while PSR1 
is Valid, "Procedure when playback condition is changed" 
is performed. After "Procedure when playback condition 
is changed", PSR1 either returns to Valid or moves to 30 
Invalid. Since an S IN Jable is provided for each Play- 
ltem, playable elementary streams change when the cur- 
rent Playltem changes. Accordingly, "Procedure when 
playback condition is changed" is performed for each 
Playltem so as to set PSR1 to a value optimal for the 35 
Playltem. 

[0131] FIG. 15B is a flowchart of "Procedure when 
playback condition is changed" for PSR1 . This procedure 
sets PSR1 through a combination of two judgment steps 
S1 and S2. 40 
[0132] First, a judgment is made as to whether the 
number of entries in the STNjable is 0 (S1 ). If the number 
of entries in the STNjable is 0, the value of PSR1 is 
maintained (S3). 

[0133] When the number of entries in the STN Jable <« 
is not 0, a judgment is made as to whether the number 
of entries in the STN . table is no smaller than PSR1 and 
also condition (A) is true (S2). Condition (A) is that the 
playback apparatus has a capability of playing an audio 
stream specified by PSR1 . If the judgment in step S2 is so 
YES, the value of PSR1 is maintained (S4). If PSR1 is 
greater than the number of entries in the STNjable or 
Condition (A) is false, PSR1 is set to a new value (S5) . 
[0134] FIG. 16 is a flowchart of a detailed procedure 
of step S5. 55 
[0135] Steps S6 and S7 form a loop in which step S8 
is performed for each audio stream listed in the 
STNjable. In this loop, an audio stream suoj ected to 
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processing is called audio stream i. A judgment is made 
as to whether audio stream i satisfies three conditions 
(a), (b), and (c) (S8). 

[0136] Condition (a) is thatthe playback apparatus has 
a capability of playing audio stream i. This judgment is 
made by comparing PSR15 and a stream_codingJype 
of audio stream i shown in the STNjable. 
[0137] Condition (b) is that a language attribute of au- 
dio stream i is same as the language setting of the play- 
back apparatus. This judgment is made by checking 
whether an audiojanguage^code of audio stream i 
shown in the STN table matches PSR16. 
[01 38] Condition (c) is that a channel attribute of audio 
stream i is surround and the playback apparatus has a 
surround output capability. This judgment is made by 
comparing PSR1 5 with an audio_presentationJype and 
the stream_coding_type of audio stream i shown in the 
STNjable. 

[0139] The following explains a case where condition 
(c) is satisfied, with reference to FIG. 1 7. FIG. 1 7 shows 
combinations of capabilities of the playback apparatus 
and stream attributes in a tabular form. The capabilities 
of the playback apparatus include stereo output and sur- 
round output. The stream attributes include stereo and 
surround. 

[01 40] Whe n the playback apparatus has a stereo out- 
put capability and the attribute of audio stream i is stereo, 
audio stream i can be played back. 
[0141] When the playback apparatus has a surround 
output capability and the attribute of audio stream i is 
stereo, audio stream i can be played back. 
[0142] When the playback apparatus has a surround 
output capability and the attribute of audio stream i is 
surround, audio stream i can be played back. 
[0143] When the playback apparatus has a stereo out- 
put capability and the attribute of audio stream i is sur- 
round, audio stream i can still be played back if the play- 
back apparatus downmixes AC-3 (5.1ch) to AC-3 (2ch) . 
Thus, audio stream i can be play back with any of the 
four combinations of the capabilities of the playback ap- 
paratus and the channel attributes of audio stream i. How- 
ever, condition (c) is defined to be true only with one of 
the four conditions, namely, the playback apparatus has 
a surround output capability and the channel attribute of 
audio stream iissurround. Thus, a strict condition is given 
as condition (c). 

[0144] Though condition (c) is defined to be true only 
with the above combination, this is merely one example, 
and condition (c) maybe defined to be true also with the 
combination in which the playback apparatus has a ster- 
eo output capability and the channel attribute of audio 
stream i is stereo. In this case, if the playback apparatus 
is only capable of stereo output or has been set to prior- 
itize stereo output over surround output, stereo playback 
of a 2ch audio stream is selected over downmixed play- 
back of a 5.1 ch audio stream. 

[0145] Based on a pattern of conditions audio stream 
i satisfies, that is, which conditions and how many con- 
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ditions audio stream i satisfies among the three condi- 
tions, a priority is given to audio stream i. 
[0146] After the loop is performed for each audio 
stream, steps S9 to S13 are performed. A judgment is 
made as to whether no audio stream satisfies condition 
(a) (S9). If there is no audio stream which satisfies con- 
dition (a), PSR1 is set to the undefined value (OxFF) 
(S14). 

[0147] A judgment is made as to whether there is any 
audio stream that satisfies all conditions (a), (b), and (c) 
(S1 0). If there is such an audio stream, PSR1 is set to a 
stream number of that audio stream (S15). 
[0148] Here, if there are two or more audio streams 
that satisfy conditions (a), (b), and (c), these audio 
streams are equal in priority. In such a case, one of the 
audio streams is selected accordingto the order of entries 
in the STNJable (S1 5) . Which is to say, if there are two 
or more audio streams that have a same combination of 
codec, language attribute, and channel attribute, one of 
the audio streams which has a highest entry in the 
STN_table is selected as a highest-oriority audio stream. 
[0149] Suppose there are three audio streams that 
have a same combination of codec, language attribute, 
and channel attribute and respectively correspond to 
main program sound, commentary sound, and BGM. In 
this case, an entry of the audio stream corresponding to 
the main program sound is placed first in the STNJable, 
which is followed by an entry of the audio stream corre- 
sponding to the commentary sound and an entry of the 
audio stream corresponding to the BGM, as shown in 
FIG. 18. As a result, the main program sound is selected 
automatically over the commentary sound and the BGM. 
[0150] Thus, by adjusting the order of audio stream 
entries In the STNJable, the author can exercise audio 
stream selection control, i.e. the authorcan specify which 
audio stream is selected for playback. 
[0151] When there is no audio stream that satisfies all 
conditions (a) , (b) , and (c) , a judgment is made as to 
whether there is any audio stream that satisfies condi- 
tions (a) and (b) (S1 1 ). If there is any audio stream that 
satisfies conditions (a) and (b), PSR1 is set to a stream 
number of an audio stream having a highest entry in the 
STNJable among the audio streams satisfying condi- 
tions (a) and (b) (S16). 

[01 52] When there is no audio stream that satisfies all 
conditions (a), (b), and (c) and no audio stream that sat- 
isfies conditions (a) and (b) , a judgment is made as to 
whether there is any audio stream that satisfies condi- 
tions (a) and (c) (S12) . If there is any audio stream that 
satisfies conditions (a) and (c) , PSR1 is set to a stream 
number of an audio stream having a highest entry in the 
STN_table among the audio streams satisfying condi- 
tions (a) and (c) (S17). 

[0153] When there is no audio stream that satisfies all 
conditions (a), (b), and (c), no audio stream that satisfies 
conditions (a) and (b), and no audio stream that satisfies 
conditions (a) and (c) , a judgment is made as to whether 
there is any audio stream that satisfies condition (a) 



(S13). If there is any audio stream that satisfies condition 
(a), PSR1 is set to a stream number of an audio stream 
having a highest entry in the STN Jable among the audio 
streams satisfying condition (a) (S18). 
[0154] This completes "Procedure when playback 
condition is changed". The following describes "Proce- 
dure when change is requested". FIG. 19 is a flowchart 
of "Procedure when change is requested" for PSR1 . The 
difference between this flowchart and the flowchart of 
FIG. 15B lies in that X is subjected to judgment instead 
of PSR1 . The value X is based on user operation infor- 
mation output from the operation reception unit 29 or a 
button command output from the Interactive Graphics 
Decoder 13. 

[0155] A judgment is made as to whether the number 
of entries in the STN_table is no smaller than X and also 
condition (A) is true (S19). Condition (A) is thatthe play- 
back apparatus is capable of playing an audio stream 
specified by X. This judgment is made by comparing 
PSR15 and a stream _codingJype of the audio stream 
shown in the STNJable. If the judgment in step S19 is 
YES, PSR1 issettoX(S21). 

[0156] If X is greater than the number of entries in the 
STNJable or condition (A) is false, a judgment is made 
as to whether X is OxFF (S22). If X is not OxFF, it means 
the audio stream number requested by the user is invalid, 
so that the value of PSR1 is maintained with the user-des- 
ignated value X being ignored (S23). 
[0157] If PSR1 is OxFF, PSR1 is set to a new value 
(S24). A procedure of step 24 is similar to the procedure 
of step S5 shown in FIG. 16, excepttorthe following. The 
judgment of step S9 is not needed in "Procedure when 
change is requested", because "Procedure when change 
is requested" maintains the value of PSR1 without setting 
PSR1 to the user-designated value X if there is no audio 
stream that satisfies any of conditions (a), (b), and (c). 
[0158] According to the above "Procedure when play- 
back condition is changed" and "Procedure when change 
is requested", an audio stream that is playable by the 
playback apparatus and that makes full use of both the 
features of the BD ROM and the playback apparatus can 
be selected. 

<Specific Examples of PSR1 Setting> 

[0159] The procedures shown in the above flowcharts 
are explained using specific examples below. 
[0160] In one soecific example, the playback appara- 
tus is a middle-level playback apparatus. The middle-lev- 
el playback apparatus referred to here does not have a 
DTS decoding capability but has an LPCM decoding ca- 
pability and an AC-3 surround output capability. Also, the 
language setting of the playback apparatus is Japanese. 
[0161] Suppose the BD-ROM on which an STNJable 
shown in FIG. 20B is recorded is loaded to this playback 
apparatus. This STNJable lists entries of six audio 
streams. 

[0162] This being the case, for each audio stream, a 
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judgment is made as to whether conditions (a) , (b) , and 
(c) are satisfied in step S8 in FIG, 16. Forexample, audio 
stream 1 which is listed first in the STNJable satisfies 
only condition (a). Audio stream2 which is listed second 
in the STNJable satisfies conditions (a) and (c). s 
[01 63] The judgment on all audio streams reveals that 
audio stream 5 satisfies all conditions (a), (b), and (c), 
audio stream 4 satisfies conditions (a) and (b), audio 
stream 2 satisfies conditions (a) and (c) , and audio 
stream 1 satisfies condition (a). The other audio streams «> 
are excluded from selection since they do not satisfy con- 
dition (a). 

[0164] Based on this result, a highest priority is given 
to audio stream 5 that satisfies all conditions (a), (b), and 
(c), as shown in FIG. 20C. Hence audio stream 5 is se- is 
lected and played together with a video stream. 
[0165] In the above example, the audio stream that 
satisfies all conditions (a), (b), and (c) is selected. The 
followingconsiders a case where the playback apparatus 
does not have a surround output capability. Suppose the 20 
playback apparatus does not have a surround output ca- 
pability, and an AC-3 (2ch) audio stream and an AC-3 
(5.1ch) audio stream are multiplexed in an AV Clip on 
the BD-ROM. According to FIG. 17, both of the audio 
streams are playable. Therefore, when these audio 25 
streams undergo the judgment in the procedure shown 
in FIG. 16, the audio streams will end up being equal in 
priority. 

[0166] In such a case, the STNJable is referenced to 
select one of the audio streams. Even if the playback 30 
apparatus is incapable of surround output, the playback 
apparatus can still play back the AC-3 (5.1 ch) audio 
stream by downmixing it to AC-3 (3ch). Such downmix- 
ing, however, may result in a lower audio quality at the 
time of playback than the one intended by the author. On 35 
the other hand, the AC-3 (2ch) audio stream is originally 
intended for stereo output. In view of this, the author may 
prefer AC-3 (2ch) playback to downmixed AC-3 (5.1ch) 
playback. 

[0167] In this case, the author places an entry of the *<> 
AC-3 (2ch) audio stream above an entry of the AC-3 
(5.1ch) audio stream in the STNJable. 
[0168] As a result, the playback apparatus without a 
surround output capability plays not downmixed AC-3 
(5,1ch) audio but AC-3 (2ch) audio. With regard to a bit -» 
rate, on the other hand, the AC-3 (5.1ch) audio stream 
has a bit rate of 384 Kbps whereas the AC-3 (2ch) audio 
stream has a bit rate of 1 92 Kbps. Thus, the AC-3 (5.1ch) 
audio stream has a higher bit rate than the AC-3 (2ch) 
audio stream. The author may consider this more impor- so 
tant than the audio quality, and prefer downmixed AC-3 
(5.1ch) playback to AC-3 (2ch) playback. In this case, 
the author places the entry of the AC-3 (5.1ch) audio 
stream above the entry of the AC-3 (2ch) audio stream 
in the STNJable. ss 
[0169] As a result, the playback apparatus without a 
surround output capability plays not AC-3 (2ch) audio but 
downmixed AC-3 (5.1 ch) audio. 



[0170] The following gives an example of STNJable 
description and audio stream selection when the author 
prefers AC-3 (2ch) playback to downmixed AC-3 (5.1ch) 
playback, by referring to FIG. 21. 
[0171] In this example, the playback apparatus does 
not have a surround output capability, so that PSR1 5 and 
PSR16 are set as shown in FIG. 21 A. Meanwhile, the 
STNJable has the same contents as the one in FIG. 
20B, as shown in FIG. 21 B. In such a case, audio stream 

4 ana audio stream 5 that satisfy conditions (a) and (b) 
have the same priority "1", and audio stream 1 and audio 
stream 2 that satisfy condition (a) have the same priority 
"2". Since audio streams 4 and 5 are equal in priority, the 
playback apparatus selects one of audio streams 4 and 

5 based on the order of entries in the STNJable. Since 
the author prefers AC-3 (2ch) playback to downmixed 
AC-3 (5.1 ch) playback, the entry of the AC-3 (2ch) audio 
stream is higher than the entry of the AC-3 (5.1ch) audio 
stream in the STN Jable shown in FIG. 21 B. In other 
words, audio stream 4 has a higher entry than audio 
stream 5 in the STNJable. Therefore, the playback ap- 
paratus selects audio stream 4 and plays audio stream 4. 
[0172] The following explains an example of 
STNJable description and audio stream selection when 
the author prefers downmixed AC-3 (5.1ch) playback to 
AC-3 (2ch) playback, by referring to FIG. 22. 

[0173] Since the author prefers downmixed AC-3 
(5.1 ch) playback, the AC-3 (5.1ch) audio streams (audio 
streams 2 and 5) respectively have higher entries than 
the AC-3 (2ch) audio streams (audio streams 1 and 4) in 
the STNJable shown in FIG. 22B. Which is to say, audio 
stream 5 is placed above audio stream 4 in the 
STNJable. Accordingly, when audio streams 4 and 5 
satisfy the same conditions (a) and (b) , the playback 
apparatus selects audio stream 5 and plays audio stream 
5, as shown in FIG. 22C 

[0174] Thus, the author can determine which of AC-3 
(2ch) playback and downmixed AC-3 (5.1ch) playback 
is performed whe n the p layback apparatus does not have 
a surround output capability. This makes it possible to 
realize playback control that reflects the preference of 
the author. This concludes the description of the status 
control regarding PSR1. 

<Status Transitions of PSR2> 

[0175] The following describes PSR2. PSR2 is used 
to specify which of a plurality of PG streams and textST 
streams listed as entries in the STNJable of the current 
Playltem is to be played. When PSR2 is changed, the 
playback apparatus plays back a PG stream or a textST 
stream specified by the changed PSR2. PSR2 is initially 
set to an undefined value, and can be set to one of the 
values 1 to 255 by the playbackapparatus. The undefined 
value is OxFFFF, indicating that no PG stream or textST 
stream is present or no PG stream or textST stream is 
selected. The values 1 to 255 are interpreted as 
PGJextST_stream numbers. FIG. 23A shows status 
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transitions that can be made by PSR2. The status tran- 
sitions shown in FIG. 23A are same as those shown in 
FIG. 15A. FIG. 23B is a flowchart of "Procedure when 
playback condition is changed" for PSR2, and FIG. 24 is 
a flowchart of "Procedure when change is requested" for 
PSR2. These flowcharts are respectively similarto those 
in FIGS. 15B and 19, but substantially differ in a PSR2 
setting procedure in steps S5 and S23. 
[0176] FIG. 25 is a flowchart of the PSR2 setting pro- 
cedure. 

[0177] In the drawing, steps S31 and S32 form a loop 
in which steps S33 to S35 are performed for each 
PG_textST_stream listed in the STN_:able. In this loop, 
the PG JextST_stream subjected to processing is called 
PG_textST_stream i. A judgment is made as to whether 
a stream_codingJype of PG_textST_stream i shown in 
the STNjable is 0x90 or 0x92 (S33). If the 
stream__coding Jype is 0x90, the procedure advances to 
step S34. 

[0178] A judgment is made as to whether 
PG_textST_stream i satisfies the following conditions (a) 
and (b) (S34). 

[0179] Condition (a) is that the playback apparatus is 
capable of playing PG stream i. 

[01 80] Condition (b) is that a language attribute of PG 
stream i matches the language setting of the playback 
apparatus. 

[0181] The judgment for condition (b) is made by 
checking whether a PG_language_code of PG stream i 
shown in the STNjable matches PSR1 7. 
[01 82] If the stream_coding_type is 0x92, a judgment 
is made as to whether PG_textST_stream i satisfies the 
following conditions (a) and (b) (S35). 
[0183] Condition (a) is that the playback apparatus is 
capable of playing textST stream i. 
[0184] Condition (b) is that a language attribute of 
textST stream i matches the language setting of the play- 
back apparatus. 

[0185] The judgment for condition (a) is made by 
checking whether PSR30 shows "capable". The judg- 
ment for condition (b) is made by checking whether a 
textSTJanguage_code of textST stream i shown in the 
STNjable matches PSR17. 

[0186] After steps S33 to S35 are performed for all 
PGJextST^streams, the procedure advances to steps 
S36to S41. 

[0187] A judgment is made as to whether there is no 
PGJextST_strearn that satisfies condition (a) (S36). If 
there is no PG_textST_stream thatsatisfies condition (a), 
PSR2 is set to an invalid value (OxFFFF) (S38). 
[0188] A judgment is made as to whetherthere is any 
PGJextST_stream that satisfies conditions (a) and (b) 
(S3 7). If there is such a PGjextST_stream, PSR2 is set 
to a stream number of a PGjextST_stream having a 

highest entry in the STN table among 

PG textST_streams satisfying conditions (a) and (b) 

(S39). 

[0189] If the judgment in step S37 is NO, PSR2 is set 



to a stream number of a stream having a highest entry 
in the STNjable among PG streams satisfyingcondition 
(a) and textST^streams satisfying condition (a) (S41). 
The procedure of this flowchart is explained in more detail 
below, using specific examples. 

<Specific Examples of PSR2 Setting> 

[0190] In one specific example, the playback appara- 
tus is capable of decoding a PG stream but incapable of 
decoding a textST stream, as shown in FIG. 26A. Also, 
the language setting of the playback apparatus is Japa- 
nese. 

[0191] Suppose the BD-ROM on which an STNjable 
shown in FIG. 26B is recorded is loaded to this playback 
apparatus. The STNjable has entries of two textST 
streams (PGJextST_streams 1 and 3) and two PG 
streams (PG JextST_streams 2 and 4). 
[0192] This being the case, steps S34 and S35 are 
performed to judge, for each PG textST_stream, wheth- 
er conditions (a) and (b) are satisfied, as shown in FIG. 
26C. Here, PGJextST_streams 1 and 3 do not satisfy 
condition (a), PGJextST_stream 2 satisfies only condi- 
tion (a), and PGJextST_stream 4 satisfies both condi- 
tions (a) and (b). 

[0193] The judgment on all PGJextST_streams in the 
STNjable reveals that PGjextST_stream 4 satisfies 
conditions (a) and lb) and PG JextST_stream 2 satisfies 
condition (a). PG textST streams 1 and 3 do not satisfy 
condition (a) and so are excluded from selection. 
[0194] As a result, PG JextST_stream 4 is given a 
highest priority. 

[0195] If there are two or more PGjextST_st reams 
that satisfy same conditions, on the other hand, these 
PGJextST_streams are equal in priority. In such a case, 
one of the PGjextST_st- earns is selected based on the 
order of entries in the STNjable. 
[0196] A specific example of PG JextST_stream se- 
lection according to the order of entries in the STNjable 
is given below, by referring to FIG. 27. In this specific 
example, the playback apparatus is capable of decoding 
both a PG stream and a textST stream. When there are 
a PG stream and s textST stream that have a language 
attribute which matches the language setting of the play- 
back apparatus, the PG stream and the textST stream 
are equal in priority. In this case, the author places an 
entry of a preferred stream above an entry of the other 
stream in the STNjable. If the author prefers the textST 
stream tc the PG stream, the author places an entry of 
the textST stream above an entry of the PG stream in 
the STNjable. As a result, the textST stream is selected 
automatically over the PG stream. 
[0197] Thus, by adjusting the order of entries in the 
STNjable, the author can exercise selection control of 
which stream is to be selected at the time of playback. 
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<Modifications> 

[01 98] The first embodiment describes the case where 
if X is invalid in "Procedure when change is requested", 
the transition control unit 30 maintains the value of PSR1 s 
or PSR2. This process is not desirable, however, in the 
case where the user presses the audio switch key or the 
subtitle switch key. When the audio switch key or the 
subtitle switch key is pressed, X should be PSR + 1. If, 
despite this, the value of PSR1 or PSR2 is maintained io 
on the ground that X is invalid, the user may think that 
the playback apparatus malfunctions. 
[0199] In view of this, when the audio switch key or the 
subtitle switch key is pressed, the transition control unit 
30 performs the following process in addition to "Proce- « 
dure when change is requested". In this process, when 
executing "Procedure when change is requested", the 
value of the PSR before "Procedure when change is re- 
quested" is compared with the value of the PSR after 
"Procedure when change is requested". If the two values 20 
are equal, X is incremented by 1, and "Procedure when 
change is requested" is performed again. X is increment- 
ed until the value of the PSR is updated by "Procedure 
when change is requested". 

[0200] Once the value of the PSR has been updated » 
by "Procedure when change is requested", the compar- 
ison of the two values results in a mismatch. The value 
of the PSR obtained by "Procedure when change is re- 
quested" at this point is used for stream selection. 
[0201] This process is explainedbrieflybelow, using a 30 
specific example where PSR1 is setto 3 and stream num- 
bers 4 and 5 are invalid. The transition control unit 30 
adds 1 to PSR1, and sets 4 as X. The transition control 
unit 30 then performs "Procedure when change is re- 
quested". Since the stream number 4 is invalid, PSR1 35 
remains 3. When PSR1 is unchanged like this, the tran- 
sition control unit 30 increments X by 1 , to thereby set X 
to 5. Having done so, the transition control unit 30 per- 
forms "Procedure when change is requested" again. 
Since the stream number 5 is invalid, PSR1 remains 3. 40 
When PSR1 is unchanged like this, the transrtion control 
unit 30 increments X by 1 , to thereby set X to 6. Having 
done so, the transition control unit 30 performs "Proce- 
dure when change is requested" again. Since the stream 
number 6 is valid, the stream number 6 is automatically 45 
selected as a result of "Procedure when change is re- 
quested". By performing the above process when the 
audio switch key is pressed, smooth audio switching can 
be achieved without making the user notice the existence 
of an invalid stream number. so 

Second Embodiment 

[0202] A second embodiment of the present invention 
relates to status settings for multi-angle blocks. A data 55 
structure for realizing a multi-angle blockcan be provided 
in the Playltem information shown in FIG. 5. FIG. 28 
shows a data structure of Playltem information corre- 



sponding to a multi-angle block. In the drawing, the Play- 
ltem information is made up of a basic part that is com- 
patible with Playltem information corresponding to a 
non-multi-angle block, and an extension partfor realizing 
the multi-angle block. The basic part has a same data 
structure as the one shown in FIG. 5, and includes a 
ClipJnformation__file_name field, a Clip_codec_identi- 
fier field, an IN_time field, an OUT_time field, and an 
STN_table field. In the multi-angle block, an AV Clip spec- 
ified by this basic part is treated as a first angle block. In 
this way, even if a playback apparatus that does not sup- 
port multi-angle (a playback apparatus that corresponds 
only to a BD-RE data structure) reads Playltem informa- 
tion corresponding to a multi-angle block, the playback 
apparatus can play the first angle block by referencing 
the basic part. Meanwhi le, the extension part is made up 
of an is_multi_angles field, a number_of_ang'les field, 
and Angle information [2], .., , [|]. 
[0203] The is multi angles field shows whether a 
playback section corresponding to the Playltem informa- 
tion is a multi-angie block or a non-multi-angle block. 
[0204] The number_of_angles field shows, when the 
isjnulti angles field shows a multi-angle block, the 
number of angles in the multi-angle block. 

[0205] The Angle information [2] Q] is information 

for each individual angle block in the multi-angle block, 
and includes a ClipJnformation_file_name field and a 
Clip_codec_identifier field. 

[0206] The ClipJnformation_file_name field shows a 
filename of an AV Clip that forms the angle block. 
[0207] The Clip_codecJdentifier field shows a coding 
method of the AV Clip specified by the filename shown 
by the ClipJnformation_file_name field in the Angle in- 
formation. 

[0208] As shown in the drawing, the Angle information 
does not have an INJime field and an OUTJime field. 
This is because a beginning and end of each angle block 
except the first angle block are specified by the IN_time 
field and the OUTJime field in the basic part. In other 
words, a playback time of the AV Clip specified by the 
Clip Information file name field in the Angle information 
needs to be same as a playback time of the AV Clip spec- 
ified by the Clip_lnformation_file_name field in the basic 
part. Also, time stamps (System Time Clock) which spec- 
ify presentation timings on the A V Clip playback time axis 
need to be equal for tne two AV Clips. 
[0209] A specific example of a Playltem corresponding 
to a multi-angle block is given below. In this specific ex- 
ample, three Playltems (Playltems #1 , #2, and #3) are 
used. Of these Playltems, Playltems #1 and #3 constitute 
multi-angle blocks, whereas Playltem #2 constitutes a 
non-multi-angle block. Also, a plurality of AV Clips shown 
in FIG. 29 (FRONT1, RIGHT1, LEFT1, FRONT2, 
FRONT3, and RIGHT 2) are recorded on the BD-ROM. 
ClipJnformation_file_names of Playltem #1 specify 
FRONT1 , LEFT1 , and RIGHT 1 , a Conformation Jile_ 
name of Playltem #2 specifies FRONT2, and Clip_ 
Information Jile_names of Playltem#3specify FRONT3 
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and RIGHT2. These Playltemsdefine a main path that is 
made up of a multi-angle block, a non-multi-angle block, 
and a multi-angle block in this order. FIGS. 30A and 30B 
show the multi-angle blocks and non-multi-angle block 
defined in this way. In the drawing, arrows my1 and my2 s 
indicate designation by two sets of Angle information in 
Play Item #1 , and arrow my3 indicates designation by one 
set of Angle information in Play Item #3. According to the 
designation my1 and my2 by the two sets of Angle Infor- 
mation in Playltem #1, one of RIGHT1 and LEFT1 can io 
be selected for playback instead of part of the AV Clip. 
Likewise, according to the designation my3 by the set of 
Angle information in Playltem #3, RIGHT2 can be select- 
ed for playback instead of part of the AV Clip. 
[0210] FIG. 30B shows a progress of playback of the « 
multi-angle blocks andnon-multi-angle block. As indicat- 
ed by arrows ag1, ag2, and ag3, one of the three angle 
blocks can be selected in multi-angle block 1. Also, as 
indicated by arrows ag4 and ag5, one of the two angle 
blocks can be selected in multi-angle block 3. This con- 20 
eludes the description of the improvements in the record- 
ing medium of the second embodiment. 
[0211] The following describes improvements in the 
playback apparatus of the second embodiment. In the 
playback apparatus, PSR3 specifies an angle block. In 25 
the second embodiment, the control unit 24 controls an- 
gle block selection and playback according to PSR3. 
[0212] In detail, the control unit 24 references PSR3, 
upon playback of the current Playltem in the current Play- 
List. If PSR3 = 1 , the control unit 24 controls the BD-ROM 30 
drive 1 to access an AV Clip specified by a Clip.. 
lnformation_file_name in the basic part of the current 
Playltem and read TS packets of the AV Clip from an 
IN_time to an OUTJime in the current Playltem. The 
read TS packets are fed to the Video Decoder 4 to play 35 
an angle block. 

[0213] If PSR3 is 2 or more, the control unit 24 controls 
the BD-ROM drive 1 to access an AV Clip (aforemen- 
tioned RIGHT1, LEFT1, or RIGHT2) specified by a 
Clip .Information .file .name in Angle Information in the *<> 
e>ctension part of the current Playltem, and readTS pack- 
ets of the AV Clip. The read TS packets are fed to the 
Video Decoder 4 to piay an angle block. Thus, by ac- 
cessing a different AV Clip depending on the value of 
PSR3, selective playback of angle blocks can be "5 
achieved. 

[0214] PSR3 which specifies an angle block is ex- 
plained below. FIG. 31 shows settings of PSR3. PSR3 
specifies a number of an angle block that is currently 
selected. PSR3 takes one of the values 1 to 9, to specify so 
one of angle blocks 1 to 9. 

[021 5] Status transitions of PSR3 are explai ned below. 
FIG. 32A shows status transitions that can be made by 
PSR3. When comparing this drawing with FIG. 15A, it 
can be understood that there is no status transition trig- 55 
gered by "Cross a Playltem boundary". Also, "Start Play- 
List playback" and "Terminate PlayList playback" have 
been replaced respectively with "Start Playltem with multi 
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angle structure" and "End of a Playltem with multi angle 
structure". Further, "Procedure when change is request- 
ed" has been changed from "stream change is request- 
ed" to "angle change is requested". Apart from these dif- 
ferences, the status transitions of PSSR3 are same as 
those shown in FIG. 15A. 

[0216] The number of audio streams differs for each 
Playltem. Accordingly, when playback of a Play List starts 
and each time the playback crosses a Playltem bound- 
ary, "Procedure when playback condition is changed" 
needs to be performed to set PSR1 . On the other hand, 
PSR3 is used only in a multi-angle block, and so there 
is no need to perform "Procedure when playback condi- 
tion is changed" each time a Playltem boundary is 
crossed. Therefore, a status transition from Invalid to Val- 
id is triggered by a start of playback of a multi-angle block, 
and a status transition from Valid to Invalid is triggered 
by an end of playback of a multi-angle block. 
[0217] In this embodiment, the value of PSR3 is main- 
tained upon the status transition from Valid to Invalid. 
Which is to say, when a multi-angle block and a non-mul- 
ti-angle block appear alternately (e.g. FIG. 30), only the 
state of PSR3 is changed from Valid to Invalid and vice 
versa, without changing the value of PSR3. This con- 
cludes the description of the status transitions of PSR3. 
The following describes "Procedure when playback con- 
dition is changed" and "Procedure when change is re- 
quested" for PSR3. 

[0218] FIG. 32B is a flowchart of "Procedure when 
playback condition is changed" for PSR3. This flowchart 
has a similar algorithm to the one shown in FIG. 15B. A 
judgment is made as to whether the number of angles in 
the current Playltem is no smaller than PSR3 (S51). If 
the number of angles in the cu rrent Playltem is no smaller 
than PSR3, the value of PSR3 is maintained (S53). Oth- 
erwise, PSR3 is set to an initial value "1" (S52). 
[0219] FIG. 32C is a flowchart of "Procedure when 
change is requested" for PSR3. This flowchart has a sim- 
ilar algorithm to the one shown in FIG. 19. A judgment is 
made as to whether the number of angles in the current 
Playltem is no smaller than X (S54). If the number of 
angles in the current Playltem is nosmallerthanX, PSR3 
is set to X (S57). Otherwise, the value of PSR3 is main- 
tained (S55). 

[0220] Angle block selection performed when playing 
the multi-angle block, the non-multi-angle block, and the 
multi-angle block in this order according to the three Play- 
Items shown in FIG. 30 is explained below, by referring 
to FIG. 33. 

[0221] In FIG. 33A, PSR3 is set to 2. This being so, 
when playback of Playltem #1 starts, the control unit 24 
selects an angle block (RIGHT1 ) specified by PSR3 = 2 
and plays the selected angle block. Once the playback 
of RIGHT 1 ends, PSR3 is changed to Invalid while being 
held at 2. 

[0222] Multi-angleblock#1 specifiedbyPlayltem#1 is 
followed by non-multi-angle block #2 specified by Play- 
ltem #2. Since this is a non-multi-angle block, PSR3're- 
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mains Invalid. Which is to say, PSR3 is treated as Invalid 
while being held at 2. Since PSR3 is Invalid, the control 
unit 24 plays part of the AV Clip (XXX.M2TS) from an 
INJime to an OUTjime of Playltem #2, irrespective of 
the value of PSR3. 5 
[0223] Non-multi-angle block #2 is followed by mul- 
ti-angle block #3 specified by Playltem #3. When play- 
back of multi-angle block #3 begins, PSR3 is changed 
from Invalid to Valid while being held at 2. Since PSR3 
becomes Valid, an angle block specified by PSR3 is se- 10 
lected. Here, PSR3= 2, so that the control unit 24 selects 
an angle block (RIGHT2) specified by PSR3= 2 and plays 
the selected angle block. Arrow gg1 in FIG. 33A indicates 
a course of angle block selection described above. 
[0224] The above concerns the case where PSR3 is 15 
set to 2. The following explains the case where PSR3 is 
set to 3. In FIG. 33B, playback of multi-angle block #1 is 
performed as in FIG. 33A. After this, PSR3 is changed 
to Invalid while being held at 3 as a result of the status 
transition shown in FIG. 32A, and playback of non-mul- 20 
ti-angle block #2 is performed in this state. After the play- 
back of non-multi-angle block #2, playback of multi-angle 
block #3 starts. Since this is the "Start Playltem with multi 
angle structure" event, "Procedure when playback con- 
dition is changed" is performed. In step S51 in FIG. 32B, 25 
a judgment is made as to whether P3R3 exceeds the 
number of angles in Playltem #3. Since the number of 
angles in Playltem #3 is 2, PSR3 = 3 exceeds the number 
of angles. Accordingly, PSR3 is set to 1 (S52) . As a 
result, the AV Clip XXX.M2TS corresponding to the first so 
angle block in Playltem #3 is selected and played back, 
as shown in FIG. 33B. Arrow gg2 in FIG. 33B indicates 
a course of angle block selection in this case. 
[0225] According to the second embodiment, PSR3 
makes such status transitions that avoid selecting a non- '« 
existent angle block. Accordingly, even when switching 
from a multi-angle block to a non-multi-angle block and 
vice versa occur frequently, a wrong number will not be 
set in PSR3. This ensures the accuracy in angle selec- 
tion, with it being possible to facilitate distribution of movie 4 o 
films that incorporate multi-angle. 

Third Embodiment 

[0226] A third embodiment of the present invention re- 45 
lates to status settings when executing an interactive 
function. The interactive function referred to here pro- 
vides a plurality of Pages, places graphics Button mem- 
bers on each Page, and receives a user operation. When 
executing the interactive function, this embodiment per- so 
forms status'settings about which Page is to be displayed 
and which Button on that Page is to be focused. 

<Data Structure for the Interactive Function> 

55 

[0227] A data structure for displaying a plurality of Pag- 
es and Buttons can be provided in the IG stream de- 
scribed in the first embodiment. The IG stream is ex- 
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plained below, with reference to FIG. 34. The IG stream 
includes an ICS, a PDS, and an ODS. The ODS is graph- 
ics data for displaying a Button graphically. The PDS is 
pallet data for specifying a color of the Button. 
[0228] The ICS is control information for displaying a 
Page synchronously with a moving picture. The synchro- 
nization with the moving picture is designated by a DTS 
and a PTS in a PES packet carrying the ICS. That is, the 
DTS in the PES packet carrying the ICS shows a begin- 
ning of a period during which the interactive function is 
valid (a period during which the ICS is Valid). 
[0229] Arrow cu1 in FIG. 34 indicates a structure of the 
ICS in detail. As illustrated, the ICS includes a 
loading_model field, a userjnterfaeejmodel field, a 
composition _time_out_pts field, a selection_time_out_ 
pts field, a user_time out. duration field, and page infor- 
mation (1), (2), ... , (i), ... , (n) which each correspond to 
a different one of a plurality of Pages available for pres- 

[0230] The loading model field shows whether the IG 
stream is multiplexed in the AV Clip or is preloaded in 
the playback apparatus separately from the AV Clip. 
[0231] The userjnterface_model field shows whether 
a Page is constantly displayed (Always-on) or popped 
up based on a user operation (Pop-up) , during the play- 
back of the moving picture. 

[0232] The compositionJime_out_pts field shows an 
end of the period during which the interactive function is 
valid. 

[0233] The user_time_out_duration field shows a pe- 
riod of time after which Page display is to time-out if there 
is no user operation. 

[0234] The page information is explained below. Arrow 
cu2 in FIG. 34 indicates a structure of the page informa- 
tion in detail. As illustrated, the page informaiion includes 
a page_id field, a U0_mask_table field, an in_effects 
field, an out^effects field, an animation_frame_ 
rate_code field, a default_selected_button_id_ref field, a 
default_activated_buttonJd_ref field, a pallet_id_ref 
field, and buttonjnfo (1), (2), ... , (i) (n) each corre- 
sponding to a different one of a plurality of Buttons. 
[0235] The pagejd field shows an identifier uniquely 
identifying a Page corresponding to the page information. 
[0236] The UO_mask_table field shows permissions/ 
prohibitions of user operations in a Display Set (DS) to 
which the ICS belongs. If this mask field is set to "Pro- 
hibited" for a user operation, that user operation to the 
playback apparatus is invalid. 

[0237] The in_effects field shows a display effect to be 
presented immediately before the Page is displayed. 
[0238] The out_effects field shows a display effect to 
be presented immediately afterthe Page is removed from 
display. 

[0239] The animation_frame_rate_code field shows a 
frame rate to be applied to an animated Button. 
[0240] The default_selected_button_id_ref field 
shows whether a Button to be set in a selected state as 
default when the presentation of the Interactive Display 
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(Page) begins is determined dynamically or statically. 
When this field is set to OxFF the Button to be set in the 
selected state as default is determined dynamically. In 
this case, a PSR in the playback apparatus is used pref- 
erentially, so that a Button specified by PSRl 0 is put in s 
the selected state. When this field is not set to OxFF, on 
the other hand, the Button to be set in the selected state 
is determined statically. In this case, PSR10 is set to a 
button number shown by the default_selected_button_ 
id_ref, and a Button specified by PSR10 is put in the io 
selected state. 

[0241] The default_activated_button_id_ref shows a 
Button to be automatically set in an activated state if the 
user does not activate any Button before a time defined 
by the selection jime_out_pts. When this field is set to « 
FF, the Button currently in the selected state is automat- 
ically set in the activated state at the time defined by the 
selectionJime_put_pts. When this field is set to 00, no 
Button is auto-activated. When this field is set to a value 
that is neither 00 nor FF, the value is interpreted as a 20 
valid button number specifying a Button to be auto-acti- 

[0242] The pallet_id_ref field shows an identifier of a 
Pallet to be set i n a CLUT unit for producing the Interactive 
Display. 25 
[0243] The buttonjnfo field defines a Button to be pre- 
sented on the Interactive Display. FIG. 35 shows a struc- 
ture of the buttonjnfo. Guideline hp1 in the drawing 
shows a structure of buttonjnfo i of Button i controlled 
by the ICS, in detail. Each individual Button presented 30 
on the Page has three states that are a normal state, a 
selected state, and an activated state. The normal state 
is a state where the Button is simply displayed. The se- 
lected state is a state where the Button is focused ac- 
cording to a useroperation but the selection ofthe Button 35 
is not confirmed yet. The activated state is a state where 
the selection of the Button has been confirmed. Since 
Button i has these three states, buttonjnfo i has the fol- 
lowing fields. 

[0244] A button_number field specifies a number *o 
uniquely identifying Button i in the ICS. 
[0245] A numerically _selectable_flag field shows a 
flag indicating whether numeric selection is available for 
Button i. 

[0246] An auto_actionJlag field shows whether Button *s 
i is to be automatically set in the activated state. When 
the auto_action_flag field is set to ON (bit value "1") , 
Button i is changed not to the selected state but directly 
to the activated state, when Button i becomes selected. 
If the auto_action_flag field is set to OFF (bit value "0"), so 
Button i is changed not directly to the activated state but 
to the selected state, when Button i becomes selected. 
[0247] A button_horizontal_position field and a 
button_verticaLposition field respectively show a hori- 
zontal position and a vertical position of a top left pixel =5 
of Button i in the Interactive Display. 
[0248] An upper_button_n umber field shows a button 
number of a Button to receive the selected state when a 



user operation of pressing the Move Up key is made while 
Button i is in the selected state. If this field shows the 
button number of Button i, then a user operation of press- 
ing the Move Up key is ignored. 

[0249] A lower_button_number field, a leftjbutton 

number field, and a right_buttonjiumber field respec- 
tively show button numbers of Buttons to receive the se- 
lected state when user operations of pressing the Move 
Down key, the Move Left key, and the Move Right key 
are performed while Button i is in the selected state. If 
any of these fields shows the button number of Button i, 
then a corresponding user operation is ignored. 
[0250] A start_object_id_normal field specifies a be- 
ginning one of objectjds that are serially assigned to a 
sequence of ODSs used to present the normal state of 
Button i in animation. 

[0251] An end_objectj'djiormal field specifies a last 
one of the objectjds that are serially assigned to the 
sequence of ODSs used to present the normal state of 
Button i in animation. If the end . object jdjiormal field 
specifies the same ID as the start_objectj'd_normal field, 
a static image of a graphics Object identified by this ID 
is presented as Button i. 

[0252] A repeatjiormaLflag field specifies whether 
the animation of Button i in the normal state is to be con- 
tinuously repeated. 

[0253] A start jDbjectj"cl_selected field specifies a be- 
ginning one of objectjds that are serially assigned to a 
sequence of ODSs used to present the selected state of 
Button i in animation. 

[0254] An end jabiectjdjselected field specifies a last 
one of the objectjds that are serially assigned to the 
sequence of ODSs used to present the selected state of 
Button i in animation. If the end_object_id_selected field 
specifies the same ID as the start_objectJd_selected 
field, a static image of a graphics Object identified by this 
ID is presented as Button i. 

[0255] A repeatjselected_flag field specifies whether 
the animation of Button i in the selected state is to be 
continuously repeated. If the start_object_id_selected 
field and the end_object_id_selected field have a same 
value, the repeat_selectedjlag field is set to 00. 
[0256] A start_objectjd jactivatedfield specifies a be- 
ginning one of objectjds that are serially assigned to a 
sequence of ODSs used to present the activated state 
of Button i in animation. 

[0257] An end jobject id activated field specifies a last 
one of the objectjds that are serially assigned to the 
sequence of ODSs used to present the activate state of 
Button i in animation. 

[0258] The following describes button commands. 
[0259] A button command (button_command) is a 
command that is executed when Button i is activated. 
The following commands (i) to (iv) are used as button 
commands, to write a value to a PSR or a GPR or read 
a value from a PSR or a GPR. 

(i) Get value of Player Status Register command 
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(written as "Getvalue of Player Status Register (aug- 
ment)*) 

This function acquires a value from a PSR specified 
by the augment. 

(ii) Set value of Player Status Register command 5 
(written as "Set value of Player Status Register (aug- 
ment 1 , augment 2)") 

This function sets a value specified by augment 2, 
to a PSR specified by augment 1 . 

(iii) Getvalue of General Purpose Registercommand 10 
(written as "Get value of General Purpose Register 
(augment) ") 

This function acquires a value from a GPR specified 
by the augment. 

(iv) Set value of General Purpose Register command is 
(written as "Set value of General Purpose Register 
(augment 1 , augment 2)") 

This function sets a value specified by augment 2, 
to a GPR specified by augment 1 . 



FIG. 38). The right_button_numberfield in the neighbor, 
info() in buttonjnfo (1) is set to specify Button 1-B. Ac- 
cordingly, when a user operation of pressing the Move 
Right key is made while Button 1-A is in the selected 
state (up2 in FIG. 38), Button 1-B receives the selected 
state (sj2 in FIG. 38). 

[0263] Arrowhh3in FIG. 38 indicates control of a status 
transition defined by neighborjnfoQ in button Jnfo(3). 
The upper_button_number field in the neighborjnfo() in 
outton_info(3), which is associated with Button 1-C, is 
set to specify Button 1-A. Accordingly, when a user op- 
eration of pressing the Move Up key is made while Button 
1-C is in the selected state iup3 in FIG. 38), Button 1-A 
is put back to the selected state (sj3 in FIG. 38) . Button 

1 -A corresponds to a b utton command "Set Page 2". This 
command instructs the playoack apparatus to switch to 
Page 2. Upon activation of Button 1-A, this command is 
executed, as a result of which Page 1 isswitchedto Page 

2 as shown in FIG. 40. 



<Specific txample> 

[0260] This concludes the description of the structure 
of the ICS. A specific example of interactive control by 
the ICS is given below. This specific example uses an 
ICS and ODSs shown in FIG. 36. FIG 36 shows a rela- 
tionship between the ICS and the ODSs included in DSn. 
The ODSs are made up of ODS1 1 to ODS1 9, ODS21 to 
ODS29, ODS31 to ODS39, and ODS41 to ODS49. 
ODS11 to ODS19 represent each state of Button 1-A, 
ODS21 to ODS29 represent each state of Button 1-B, 
ODS31 to ODS39 represent each state of Button 1-C, 
and ODS41 to ODS49 represent each state of Button 
1-D, as indicated by the parenthesis "}" in the drawing. 
The ICS contains page information (1), (2), and (3) cor- 
responding to three Pages 1 to 3. Status control of But- 
tons 1-A to 1-D is defined in buttonjnfo (1), (2), (3), and 
(4) in page information (1) of Page 1 (as indicated by 
arrows bhl, bh2, bh3, and bh4 in the drawing). 
[0261] When timing of the control by the ICS matches 
presentation timing of picture data ptl of a moving picture 
shown in FIG. 37, Page 1 out of the three Pages (Pages 
1 to 3) available for presentation by the ICS is overlaid 
on picture data ptl and displayed (gs2) Thus, an Inter- 
active Display provided with a plurality of Buttons is pre- 
sented in correspondence with the contents of the mov- 
ing picture. In this way, realistic presentation using But- 
tons can be achieved through the use of an ICS. 
[0262] FIG. 39 shows an example of ICS description 
for defining status transitions of Buttons 1 -A to 1 -D shown 
in FIG. 38. Arrows hh1 and hh2 in FIG. 38 represent 
status transitions defined by neighborjnfoQ in 
buttonjnfo (1 ), which is associated with Button 1 -A. The 
lower button number field in the neighborjnfoQ in 
buttonjnfo (1 ) is set to specify Button 1 -C. Accordingly, 
when a user operation of pressing the Move Down key 
is made while Button 1-A is in the selected state (up1 in 
FIG. 38) , Button 1-C receives the selected state (sj1 in 



<Playback Apparatus> 

[0264] This concludes the description of the improve- 
ments in the recording medium of the third embodiment. 

25 The following describes the playback apparatus of the 
third embodiment. Of the plurality of PSRs in theplayback 
apparatus, PSRO, PSR11, and PSR10 relate to the in- 
teractive function. PSRO, PSR10, and PSR11 are ex- 
plained below, with reference to FIG. 41. 

so [0265] PSRO specifies one of a plurality of IG streams 
which are listed as entries in the STNJable of the current 
Playltem. 

[0266] PSR1 1 specifies, when the IG stream specified 
by PSRO contains a plurality of Pages available forpres- 
35 entation, one of the plurality of Pages. 

[0267] PSR1 0 specifies, when the Page specified by 
PSR1 1 has a plurality of Buttons, one of the plurality of 
Buttons. 

[0268] To realtee the interactive function, PSRO makes 

40 the following status transitions. PSRO is initially set at 1 , 
and can be set to any of the val ues 2 to 32 by the playback 
apparatus. FIG. 42A shows status transitions that can be 
made by PSRO. FIG. 42B is a flowchart of "Procedure 
when playback condition is changed" for PSRO. FIG. 43 

45 is a flowchart of "Procedure when change is requested" 
for PSRO. These status transitions and flowcharts are 
same as those of PSR1 and PSR2 described in the first 
embodiment. As in the case of audio streams and 
PG JextST_streams, when IG streams corresponding to 

so multiple languages are multiplexed in the AV Clip, one 
of the IG streams that matches the language setting of 
the playback apparatus is selected and played back. 
Here, the playback apparatus selects the IG stream de- 
pending on the order of entries in the STNJable. There- 

55 fore, by adjusting the order of entries in the STNJable, 
the author can control which IG stream is to be selected. 
This concludes the description of the status transitions 
of PSRO. 
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[0269] PSR10 and PSR11 make status transitions 
similarto those described in the first and second embod- 
iments, too. This will be described in detail later. 
[0270] The following describes a construction of the 
playback apparatus of the third embodiment. PSRO spec- 
ifies the IG stream to be played. This being so, the control 
unit 24 and the Demultiplexer 3 perform the following 
processing. 

[0271] The control unit 24 extracts a PID from one of 
the entry-attribute combinations of IG streams in the 
STN__tab!e that is specified by PSRO, and sets the PID 
in the Demultiplexer 3. 

[0272] The Demultiplexer 3 outputs, from among TS 
packets read from the BD-ROM and the HD, TS packets 
having the PID set by the control unit24, to the Interactive 
Graphics Decoder 13. Hence an ICS, a PDS, and an 
ODS are fed to the Interactive Graphics Decoder 13. 

internal Construction of the Interactive Graphics De- 
coder 13> 

[0273] An internal construction of the Interactive 
Graphics Decoder 13 is described below, with reference 
to FIG. 44. As shown in the drawing, the Interactive 
Graphics Decoder 13 includes a Coded Data Buffer 33, 
a Stream Graphics Processor 34, an Obj ect Buffer 35, 
a Composition Buffer 36, and a Graphics Controller 37. 
[0274] The Coded Data Buffer 33 is a buffer for tem- 
porarily storing an ICS, a PDS, and an ODS together with 
DTSs and PTSs. 

[0275] The Stream Graphics Processor 34 decodes 
the ODS to obtain uncompressed graphics, and writes 
the uncompressed graphics to the Object Buffer 35. 
[0276] The Object Buffer 35 is a buffer for storing a 
plurality of sets of uncompressed graphics (represented 
by the rectangles in the drawing) generated by the 
Stream Graphics Processor 34. 

[0277] The Composition Buffer 36 is a memory forstor- 
ing an ICS. The Composition Buffer 36 outputs a plurality 
of sets of page information in the ICS and a plurality of 
buttonjnfo structures in each set of page information, to 
the Graphics Controller 37. 

[0278J The Graphics Controller 37 refers to each 
buttonjmfo structure in page information specified by 
PSR1 1 (current page information) out of the plurality of 
sets of page information in the ICS stored in the Compo- 
sition Buffer 36, and renders graphics. In detail, the 
Graphics Controller 37 reads graphics specified by a 
start_object_id_normal field value and an end_object_ 
id^normal field value of norrnaLstatejnfo of each 
buttonjnfo structure in the current page information from 
the Obj ect Buffer 35, and writes the read graphics to the 
Interactive Graphics Plane 15. Regarding a buttonjnfo 
structure specified by PSR1 0, the Graphics Controller 37 
reads graphics specified by a start_ob)ectjd_selected 
field value and an end_objecMd_se!ected field value of 
selected_stateJnfo of the buttonjnfo structure from the 
Object Buffer 35, and writes the read graphics to the In- 



teractive Graphics Plane 15. Arrows bg1, bg2, bg3, and 
bg4 in FIG. 44 represent the rendering of the graphics 
by the Graphics Controller 37. As a result of the render- 
ing, a Page including Buttons 1 -A to 1-D is stored on the 
s Interactive Graphics Plane 15 and overlaid on a moving 
picture. 

[0279] This concludes the rough description of the pro- 
cedure to be performed by the Graphics Controller 37. 
FIGS. 45 to 51 show the procedure to be performed by 

10 the Graphics Controller 37 in greater detail. 

[0280] FIG. 45 is a flowchart of a main routine of the 
procedure performed by the Graphics Controller 37. In 
this flowchart, while conducting step S88 (an animation 
procedure) and step S89 (an UO procedure) Judgments 

15 are made in steps S81 , S82, and S83 as to whether spe- 
cific events have occurred. If any of the events has oc- 
curred, corresponding steps are performed and the pro- 
cedure returns to the main routine. 
[0281] A judgment is made as to whether the current 

20 playback time has reached a point when the ICS be- 
comes valid (S81). If the judgment in step S81 is YES, 
PSR10 is set to specify first page information in the ICS 
(S84) . After this, a current page display procedure is 
carried out (S85). 

25 [0282] A judgment is made as to whether the current 
playback time has reached a point shown by the 
selection Jime_out_pts (S82) . If the judgment in step 

582 is YES, a button activation procedure is carried out 
(S86). 

30 [0283] A judgment is made as to whether the current 
playback time has reached a ooint shown by the 
compositionjime out_pts (S83). If the judgment in step 

583 is YES, the Interactive Graohics Plane 1 5 is cleared 
and PSR10 and PSR11 are cnanged to Invalid (S87). 

35 Thiscompletesthesynchronization procedure usingtime 
stamps. In this synchronization procedure, steps S85 and 
S86 are performed by calling subroutines. A procedure 
of the subroutine of step S85 is described below, with 
reference to FIG. 46. 

40 [0284] FIG. 46 is a flowchart of an initial display pro- 
cedure. A display effect specified by the in_effects field 
of the current page information is executed (S91). After 
this, a current button setting procedure is performed 
(S92). The current Button is specified by PSR1 0. Aceord- 

45 ingly, "Procedure when playback condition is changed" 
for PSR10 is performed to determine the current Button. 
Once the current Button has been determined as a result 
of step S92, the procedure advances to steps S93 to S98. 
[0285] Steps S93 to S98 form a loop that is performed 

so for each buttonjnfo structure in the current Page (S93 
and S94). Button-info to be processed in this loop is called 
buttonjnfo (p). 

[0286] A judgment is made as to whether buttonjnfo 
(p) corresponds to the current Button (S95). If the judg- 
55 ment in step S95 is YES, the procedure advances to step 
S96. If the judgment in step S95 is NO, the procedure 
advances to step S97. 

[0287] In step S96, a graphics Object specified by a 
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starLobjecHcLselected field value of selected_state_ 
info in buttonjnfo (p) is designated as graphics Object 
(p) in the Object Buffer 35. 

[0288] In step S97, a graphics Object specified by a 
starLpbjectjd_normal field value of normal_state_info 
in buttonjnfo(p) is designated as graphics Object(p) in 
the Object Buffer 35. 

[0289] Once graphics Object (p) has been designated 
as a result of step S96 or S97, graphics Object(p) is writ- 
ten onto the Interactive Graphics Plane 15 at a position 
specified by a button_horizontalj3osition field value and 
a button_vertical_position field value inbutton Jnfo(p) 
(S98). As a result of performing this operation for each 
buttonjnfo structure in the current Page, among a plu- 
rality of graphics Objects associated with each button 
state, an initial graphics Object is rendered for each But- 
ton to the Interactive Graphics Plane 15. 
[0290] A procedure of the subroutine of step S86 is 
explained next, with reference to FIG. 47. 
[0291] FIG. 47 is aflowchart of abutton auto-activation 
procedure. A judgment is made as to whether a 
default jactivatedJauttonjcLref is 00 or FF (S1 00). If the 
default_actlvated_buttonjd_ref is 00, the procedure re- 
turns to the main routine without performing any step. If 
the default_activated_button_id_ref is FF, current Button 
i is activated (S102). Following this, variable animation 
(i) corresponding to current Button i is set to 0. The pro- 
cedure then returns to the main routine (S103). 
[0292] If the default. activated_button_id_ref is neither 
00 nor FF, a Button specified by the Default., activated.. 
buttonjd_ret is set as current Button i (S101), and cur- 
rent Button i is activated (S1 02). Following this, animation 
(i) corresponding to current Button i is set to 0. The pro- 
cedure then returns to the main routine (S1 03) . 
[0293] As a result of the above procedure, a Button in 
the selected state is activated after a predetermined time 
period. This concludes the description of the flowchart of 
FIG. 47. 

[0294] The following describes a procedure of anima- 
tion display on a Page. FIG. 48 is a flowchart of the an- 
imation display procedure, 

[0295] The Initial display is presented by writing the 
graphics Object specified by the start_objectjd_normal 
in the normal_stateJnfo or the starr_objectjd_selected 
in the selected_statejnfo in each buttonjnfo structure, 
onto the Interactive Graphics Plane 15. Animation means 
an operation of updating each Button image by overwrit- 
ing the Interactive Graphics plane 15 with an arbitrary 
one of a sequence of graphics Objects (qth graphics Ob- 
ject) associated with the Button, in each repetition of the 
main routine. That is to say, each Button is presented in 
animation by rendering a sequence of graphics Objects 
associated with the normal_statejnfo or selected_ 

state info provided within each buttonjnfo structure, 

one by one to the Interactive Graphics Plane 15. Here, 
variable q is used to specify an individual graphics Object 
associated with the normal_stateJnfo or selected^ 
statejnfo provided within each buttonjnfo structure. 



[0296] The animation display procedure is described 
below, by referring to FIG. 48 . For simplicity's sake, this 
flowchart is based on a premise that the repeats 
normal Jlag and the repeat_selected_flag in each 
s buttonjnfo structure in the ICS are set to indicate that 
the continuous repetition is required, 
[0297] A judgment is made as to whether the initial 
display has been performed (S1 10) If the initial display 
is not yet performed, the procedure returns to the main 
10 routine without performing any step. If the initial display 
has been performed, the procedure advances to steps 
S1 1 1 to S123. Steps S1 1 1 to S123 form a loop in which 
steps S113 to S123 are performed for each buttonjnfo 
structure (button .info(p)) of the current page, information 
15 in the ICS (S1 11 and S1 12). 

[0298] Variable q is set to the value of animation(p) 
corresponding to buttonjnfo(p) (S1 13). As a result, var- 
iable q represents the current frame number for 
button info (p) . 
20 [0299] A judgment is made as to whether buttonjnfo 
(p) corresponds to the current Button, i.e. the Button 
which is currently in the selected state (S1 14). 
[0300] If the judgment in step S144 is NO, a value ob- 
tained by adding variable q to the start_objectjd_normal 
2s of the normal_stateJnfo in buttonjnfo (p) is set as ID 
(q)(S115). 

[0301] If the judgment in step S 1 1 4 is YES, the proce- 
dure advances to step S1 16. 

[0302] In step S1 1 6, a judgment is made as to whether 

30 the current Button is in the activated state. If the current 
outton is in the activated state, a value obtained by adding 
variable q to the start_objectjdjactivated of the 
actioned_stateJnfo in buttonjnfo (p) is set as ID(q) 
(Si 1 7). After this, one of button commands in button Jnfo 

35 (p) is executed (S1 18). 

[0303] If the current Button is not in the activated state, 
a value obtained by adding variable q to the 
start_objectJd_selected of the selectedjstatejinfo in 
buttonjnfo(p) is set as ID(q) (S1 19). 

to [0304] Once ID(q) has been determined in this way, 
graphics Object (q) identified by ID (q) is read from the 
Object Buffer 35 and written to the Interactive Graphics 
Plane 15 at a position shown by the button J"iorizontal_ 
position and the button_vertical_position in buttonjnfo 

45 (p)(S120). 

[0305] As a result, the qth graphics Object in the se- 
quence of graphics Objects representing the selected 
state (or the activated state) of the current Button or the 
normal state of any of the other Buttons in animation is 

so obtained on the Interactive Graphics Plane 15. 

[0306] A judgment is made as to whether the sum of 
the start_objectJd_normal and variable q has reached 
the end_objectJd_normal in button Jnfo(p) (S121). If the 
judgment in step S121 is NO, variable q is incremented 

55 by1 and assigned to animation(p) (S1 22). Ifthejudgment 
in step S121 is YES, animation(p) is initialized to 0 
(S123). The above operation is repeated for each 
button jnfo structure of the current page information in 
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the ICS (S1 1 1 and S1 12) . Once the operation has been 
completed for all button jnfo structures, the procedure 
returns to the main routine. 

[0307] As a result of steps S1 10 to S123, each Button 
image on the Interactive Display is updated using a new 
graphics Object each time the main routine is performed. 
Repeating the main routine over and over again enables 
the Button images to be presented in animation. When 
presenting the Buttons in animation, the Graphics Con- 
trollers? adjusts the duration for presenting each graph- 
ics Object so as to maintain the animation_frame_ 
rate_code. 

[0308] A button command execution procedure is ex- 
plainedbelow, with reference to a flowchart of FIG. 49. 
One button_command is extracted from in the 
buttonjnfo (S131). A judgment is made as to whether 
the button_command is a Page switching command 
(S132). If the button_command is not a Page switching 
command, the button_command is executed (S133). If 
the button__command is a Page switching command, a 
display effect specified by the out_effects in the current 
Page is executed (S134). Following this, a switching des- 
tination page number specified by an operand of the 
button_command is set as X, and a button number spec- 
ified by an operand of the outton_command is set in 
PSR10 (S135) . After this, "Procedure when change is 
requested" for PSR1 1 is performed (S136). PSR1 1 spec- 
ifies the current Page. By performing "Procedure when 
change is requested" for such PSR1 1 , the current Page 
is determined. Afterthis, "Procedure when playbackcon- 
dition is changed" is performed for PSR10. This com- 
pletes the button command execution procedure. 
[0309] This concludes the description of the button 
command execution procedure. The following describes 
an UO procedure in step S89 of the main routine, witn 
reference to FIG. 50. 

[0310] FIG. 50 is a flowchart of the UO procedure. In 
this flowchart, steps S1 40 to S1 43 are performed to judge 
whether specific events have occurred. If any of the 
events has occurred, corresponding steps are performed 
and then the procedure returns to the main routine. A 
judgment is made as to whether the U0_mask_table in 
the current Page is set to 1 (S140). if the judgment in 
step S1 40 is YES, the procedure returns to the main rou- 
tine without performing any step. 
[0311] A judgment is made as to whether any of the 
Move Up key, the Move Down key, the Move Left key, 
and the Move Right key has been pressed (S141). If the 
judgment in step S141 is YES, a current Button change 
procedure is performed (S147), and a judgment is made 
as to whether the auto_._action .jlag of the current Button 
is 01 (S148). If the judgment in step S148 is NO, the 
procedure returns to the main routine. If the judgment in 
step S 1 48 is YES, the procedure advances to step S 1 44. 
[0312] A judgment is made as to whether a numeric 
input has beenmade (S143) . If the numeric input has 
beenmade, a numeric input operation is performed 
(S146). Afterthis, the procedure returns to the main rou- 



tine. 

[031 3] A judgment is made as to whether the Activated 
key has been pressed (S142). If the judgment in step 
S142 is YES, current Button i is activated (S144). After 

s this, animation(i) is set to 0 (S145). In the procedure 
shown in FIG. 50, step S147 is performed by calling a 
subroutine. FIG. 51 showsaprocedu re ofthis subroutine. 
[0314] FIG.51 is aflowchart of a current button change 
procedure. First, from the upper_button_n umber, the 

io iower_button_number, the left_button_number, and the 
right_button_n umber in the neighbor Jnfo associated 
with the current Button, a button number that corre- 
sponds to the pressed key is specified {S150). 
[031 5] The current Button is set as button Y, and a new 

is Button identified by the specified button number is set as 
Button X (SI 51). To set PSR10 to X, "Procedure when 
change is requested" is performed (S152). 
[0316] After the setting, animation (X) and animation 
(Y) are set to 0. The procedure then returns to the main 

20 routine (S1 53). 

[0317] This concludes the description of the proce- 
dures performed by the Interactive Graphics Decoder 1 3. 

<Specific Examples of Focus Shift> 

25 

[031 8] I n the above Page switchi ng, th e author decides 
which Button in the switch destination Page is to be set 
in the selected state. This raises an issue of how to per- 
form a focus shift. A focus referred to here indicates a 
30 Button which is in the selected state. A focus shift is to 
dynamically or statically change the Button in the select- 
ed state in accordance with Page switching, using the 
aforementioned button command or default selected but- 
ton. 

35 [0319] The following describes a focus shift for aiding 
the viewing of a package medium on which a plurality of 
sets of content such as a drama series are recorded. In 
the package medium recording ihe drama series, content 
corresponding to each of the episodes such as the first 

40 to fourth episodes is contained in one disc. In this case, 
playback is general ! y performed in the order of episodes, 
i.e. the first episode -> the second episode — > the third 
episode -» the fourth episode. This being so, it is trou- 
blesome forthe userto perform, on a selection menu, an 

*> operation of selecting the next episode each time play- 
back of one episode ends. 

[0320] FIG. 52 shows a specific example ofthis selec- 
tion operation. In the drawing, the selection menu has 
Buttons corresponding to the first to fourth episodes. 

so When the selection of one Button is confirmed, a chapter 
menu for an episode corresponding to that Button is dis- 
played. After the display of the chapter menu, the selec- 
tion menu is displayed again. On this selection menu, 
the user needs to perform a key operation to select the 

55 next episode, in detail, when a chapter menu of the first 
episode is displayed (hw1) and then the selection menu 
is displayed again (hw2), the user needs to perform a 
key operation (ks1) to select the second episode. 
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[0321] Also, when a chapter menu of the second epi- 
sode is displayed (hw3) and then the selection menu is 
displayed again (hw4), the user needs to perform a key 
operation (ks2) to select the third episode. 
[0322] A focus shift alleviates such a trouble of having 
to perform key operations. The following describes a pro- 
cedure of performing a focus shift. FIG. 53 shows how 
Pages 1 to shown in FIG. 52 are assigned to the selection 
menu and the chapter menus. Here, Page 1 is assigned 
to the selection menu, Page 2 is assigned to the chapter 
menu of the first episode, Page 3 is assigned to the chap- 
ter menu of the second episode, and Page 4 is assigned 
to the chapter menu of the third episode. 
[0323] Also, Buttons 1 -A to 1 -D on Page 1 are assigned 
respectively to selection Buttons forthe first to fourth ep- 
isodes in the selection menu, and Buttons 2-A to 2-F on 
Page 2 are assigned respectively to selection Buttons 
for chapters 1 to 5 and a return Button in the chapter 
menu of the first episode. The return Button referred to 
here is a Button for accepting a user operation of display- 
ing the selection menu again. 

[0324] This being the case, button commands of But- 
ton 1-A on Page 1 and button commands of Button 2-F 
on Page 2 define procedures such as those shown in 
FIG. 54. Procedures defined by the button commands of 
Button 1 -A are the following. When the selection of But- 
ton 1-A is confirmed, (1) the value of PSR10 is saved to 
a GPR, (2) PSR11 is set to 2, and (3) PSR1 0 is set to 1 . 
[0325] By setting the PSRs in this way, the chapter 
menu of t:he first episode is displayed with Button 2-A 
being in the selected state. 

[0326] Meanwhile, procedures defined by the button 
commands of Button 2-F are the following. When the 
selection of Button 2-F is confirmed, (i) PSR11 is set to 
1 , and (2) PSR1 0 is set to a sum of 1 and the value saved 
to the GPR. 

[0327] According to these procedures defined by the 
button commands of Button 1-A on Page 1 and Button 
2-F on Page 2, when the display of the chapter menu of 
thefirst episode ends andthe selection menu is displayed 
again, the focus is automatically shifted from the Button 
for the first episode to the Button for the second episode 
on the selection menu. By defining button commands of 
Buttons 1 -B to 1 -D on Page 1 and the Buttons of the other 
Pages in a similar way, focus shifts such as those shown 
in FIG. 55 can be realized. 

[0328] With the aid of such focus shifts, the user can 
easily search the drama series made up of a number of 
sets of content, for a chapter which he or she wants to 

view. 

[0329] To realize the above focus shifts, it is necessary 
to define button commands for each individual Button. 
This being so, if there are many Pages and Buttons, a 
bug may occur. This raises the need for conducting a 
test to find bugs. 

[0330] Bugs likely to occur in focus shifts are as follows. 
When displaying Page 1, if the above procedures are 
performed while Button 1-D is in the selected state, a 



button number {= 5) obtained by adding 1 to a button 
number of Button 1-D is written to PSR10 upon switching 
from Page 1 , Page 2, and back to Page 1 . Since Page 1 
does not have a fifth Button, the focus will end up being 
s shifted to a nonexistent Button on Page 1. Also, there 
may be a case where after the sixth Button (Button 1-F) 
on Page 2 is set in the selected state, Page 1 is displayed 
again without updating PSR10, as shown in FIG. 56. In 
this case too, the focus will end up being shifted to a 

10 nonexistent Button on Page 1 . Thus, when the number 
of Buttons on each Page is different, a bug of putting a 
nonexistent Button on a switch destination Page into the 
selected state can occur frequently. Such defects need 
be corrected upon shipment of content. Accordingly, the 

is author must perform a debug test to ensure normal op- 
erations, as in the case of shipment of programs. How- 
ever, the imperative for the author to perform such a de- 
bug test as being conducted by a software house may 
adversely affect the content production that is the core 

20 business of the author. 

[0331] In view of this, the third embodiment of the 
present invention applies status transitions through "Pro- 
cedure when playback condition is changed" and "Pro- 
cedure when change is requested", to PSR10 and 

25 PSR1 1 in the same way as PSR1 , PSR2, and PSR3. 

<Status transitions of PSR1 1 > 

[0332] PSR1 1 specifies a Page which is currently dis- 

30 played among a plurality of Pages included in the IG 
stream (current Page) . PSR1 1 takes one of the values 
00 to FF, and the playback apparatus displays the Page 
specified by PSR1 1 . FIG. 57A shows status transitions 
that can be made by PSR1 1 . When comparing this draw- 

35 ing with FIG. 15A, it can be seen that there is no status 
transition triggered by the "Cross a Playltem boundary" 
event. Also, an event that triggers a status transition from 
Invalid to Valid has been changed from "Start PlayList 
playback" to " I nteractive Composition Segment becomes 

io Valid", and an event that triggers a status transition from 
Valid to Invalid has been changed from "Terminate Play- 
List playback" to "Interactive Composition Segment be- 
comes Invalid". Also, "Procedure when change is re- 
quested" has been changed from "stream change is re- 

45 quested" to "page change is requested. Apart from these 
differences, FIG. 57A is same as FIG. 15A. 
[0333] "Interactive Composition Segment becomes 
Invalid" includes an event that the current playback time 
has reached a point specified by the composition^ 

so time„„ouLpts in an ICS, an event that an ICS has 
changed, and an event that PlayList playback ends. The 
number of audio streams differs for each Playltem. Ac- 
cordingly, when PlayList playback starts and each time 
a Playltem boundary is crossed, "Procedure when play- 

55 back condition is changed" needs to be performed to set 
PSR1 . However, PSR1 1 is used only in a playback sec- 
tion where an ICS is multiplexed, and so there is no need 
to perform "Procedure when playback condition is 
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changed" each time a Playltem boundary is crossed. 
Therefore, a status transition from Invalid to Valid of 
PSR11 is triggered by an event that an ICS becomes 
Valid. 

[0334] "Procedure when playback condition is s 
changed" for PSR11 is explained below. FIG. 57B is a 
flowchart of "Procedure when playback condition is 
changed" for PSR1 1 . In "Procedure when playback con- 
dition is changed", first page information in the ICS is set 
in PSR11 (S154). 10 
[0335] FIG. 57C is a flowchart of "Procedure when 
change is requested" for PSR1 1. A judgment is made as 
to whether X is Valid (S1 55). If X is Valid, X is assigned 
to PSR1 1 (S156). If X is Invalid, the value of PSR11 is 
maintained (S157). This concludes the description of '5 
PSR11. 

<Status Transitions of PSR10> 

[0336] The following describes status transitions of 20 
PSR10. FIG. 58A shows status transitions that can be 
made by PSR10. This drawing is same as FIG. 57A, ex- 
cept that a status transition triggered by an event 
"Change Page" or "Button Disabled" has been added. 
Also, "Procedure when change is requested" has been 25 
changed from "page change is requested" to "button 
change is requested". 

[0337] "Change Page" is an event that Page switching 
is requested. "Button Disabled" is an event that a Burton 
displayed on a Page is disabled. Upon the occurrence 30 
of such an event, "Procedure when playback condition 
is changed" is performed to set PSR1 0, and then PSR10 
returns to Valid. 

[0338] "Procedure when playback condition is 
changed" and "Procedure when change is requested" for 35 
PSR1 0 are described below. 

[0339] FIG. 58B is a flowchart of "Procedure when 
playback condition is changed" for PSR1 0. 
[0340] A judgment is made as to whether the 
default_selected_button_id_ref in the current Page is 40 
Valid (S161). lfthejudgmentinstepS161 is YES, PSR10 
is set to the default_selected_button_id_ref (S1 62). 
[0341] If the judgment in step S161 is NO, a judgment 
is made as to whether PSR10 is Valid (S1 63) . If PSR1 0 
is Valid, the value of PSR10 is maintained (S164). If •« 
PSRIOis Invalid, PSR10 is setto a button number of the 
first buttonjnfo structure in the current Page (S165). 
[0342] FIG. 59 is a flowchart of "Procedure when 
change is requested" for PSR10. First, a judgment is 
made as to whetherX is Valid (S1 66). If X is Valid, PSR10 so 
is set to X (S168). If X is Invalid, the value of PSR10 is 
maintained (S167). 

[0343] According to the above procedures, when 
PSR10 is Invalid, PSR1 0 is set so that the Button spec- 
ified by the first buttonjnfo structure of the current Page 55 
is set in the selected state. Accordingly, even if the author 
designates a button number of a Button which does not 
exist in a switch destination Page, a process of changing 



the wrong button number to a correct button number is 
automatically performed. Thus, even if a button com- 
mand for realizing afocusshift has a defect, such a defect 
can be automatically corrected. This reduces the burden 
on the author. 

Modifications 

[0344] Though the present invention has been de- 
scribed by way of the above embodiments, the present 
invention is not limited to such. The present invention 
can be realized with any of modifications (A) to |M) given 
below. The invention of each of the claims of this appli- 
cation includes extension and generalization of the above 
embodiments and their modifications below. The degree 
of extension and generalization depends upon the state 
of the art in the technical field of the present invention at 
the time of filing of this application. 

(A) The above embodiments describe the case 
where the BD-ROM is used as the recording medium 
according to the present invention. Main features of 
the present invention, however, lie in a graphics 
stream recorded on the recording medium, which 
does not rely on physical characteristics of 
BD-ROMs. Therefore, the present invention is appli- 
cable to any recordingmediumthat is capable of re- 
cording a graphics stream. Examples of such a re- 
cording medium include: an optical disc such as a 
DVD-ROM, a DVD-RAM, a DVD-RW, a DVD-R, a 
DVD+RW, a DVD+R, a CD-R, or a CD-RW; a mag- 
neto-optical disk such as a PD or an MO; a semicon- 
ductor memory card such as a CompactFlash card, 
a SmartMedia card, a Memory Stick card, a Multi- 
MediaCard, or a PCMCIA card; a magnetic disk such 
as a flexible disk, SuperDisk, Zip, orClik!; a remov- 
able hard disk drive such asORB, Jaz, SparQ, SyJet, 
EZFley, or Microdrive, and a nonremovaDle hard disk 
drive. 

(B) The above embodiments describe the case 
where the playback apparatus decodes an AV Clip 
on the BD-ROM and outputs the decoded AV Clip 
to the television. As an alternative, the playback ap- 
paratus maybe equipped with only a BD-ROM drive, 
with the remaining construction elements being pro- 
vided in the television. In this case, the playback ap- 
paratus and the television can be incorporated in a 
home network connected with an IEEE 1394 con- 
nector. The above embodiments describe the case 
where the playback apparatus is connected to the 
television, but the playback apparatus may instead 
be integrated with a display device. Also, the play- 
back apparatus may include only the systemLSI (in- 
tegrated circuit) which constitutes an essential part 
of processing. The playback apparatus and the in- 
tegrated circuit are both an invention describee- in 
this specification. Accordingly, regardless of whether 
the playback apparatus or the integrated circuit is 
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concerned, an act of manufacturing a playback ap- 
paratus based on the internal construction of the 
playback apparatus described in the first embodi- 
ment is an act of working of the present invention. 
Also, any act of assigning with charge (i.e. for sale) s 
or without charge (i.e. as a gift), leasing, and import- 
ing the playback apparatus is an act of workin- 
gofthepresentinvention. Likewise, an act of offering 
for assignment or lease of the playback apparatus 
using storefront displays, catalogs, or brochures is io 
an act of working of the present invention. 

(C) Information processing using the programs 
shown in the flowcharts is actually realized using 
hardware resources. Accordingly, the programs 
which describe the operational procedures shown in 15 
the flowcharts are themselves an invention. The 
above embodiments describe the case where the 
programs are incorporated in the playback appara- 
tus, but the programs can be used independently of 

the playback apparatus. Acts of working of the pro- 20 
grams include (1) an act of manufacturing, (2) an act 
of assigning witnorwithout charge, (3) an act of leas- 
ing, (4) an act of importing, (5) an act of providing to 
the public via a bi-directional electronic communica- 
tions network, and (6) an act of offering for assign- 25 
ment or lease using storefront displays, catalogs, or 
brochures. 

(D) The time elements of the steps which are exe- 
cuted in a time series in each of the flowcharts can 

be regarded as the necessary elements of the 30 
present invention. This being so, a playbackmethod 
shown by these flowcharts is an invention. If the 
processing shown in each flowchart is carried out by 
performing the steps in a time series so as to achieve 
the intended aim and the intended effect, this is an 35 
act of working of the recording method of the present 
invention. 

(E) When recording an AV Clip on the BD-ROM, an 
extension header may be added to each TS packet 

in the AV Clip. The extension header is called a 40 
TP_extra_header, includes an arrivaLtime_stamp 
and a copy_permission_indicator, and has a data 
length of 4 bytes. TS packets with TP_extra__headers 
(hereafter "EX TS packets") are grouped in units of 
32 packets, and each group is written to three sec- « 
tors. One group made up of 32 EX TS packets has 
6,1 44 bytes (= 32x1 92), which is equivalent to a size 
of three sectors that is 6144 bytes (= 2048x3). The 
32 EX TS packets contained in the three sectors are 
called an Aligned Unit. so 
In a home network connected with an IEEE 1394 
connector, the playback apparatus transmits an 
Aligned Unit in the following manner. The playback 
apparatus removes a TP__extra_header from each 
of the 32 EX TS packets in the Aligned Unit, encrypts 55 
the body of each TS packet according to the DTCP 
Specification, and outputs the encrypted TS packets. 
When outputting the TS packets, the playback ap- 



paratus inserts an isochronous packet between ad- 
jacent TS packets. A position where the isochronous 
packet is inserted is based on a time shown by an 
arrival_time_stamp of the TP_extra_header. The 
playback apparatus outputs a DTCP„descriptor, as 
well as the TS packets. The DTCP_descriptor cor- 
responds to a copy_permission_indicator in the 
TP_extra_header. With the provision of the 
DTCP_descriptor indicating "copy prohibited", it is 
possible to prevent, when using the TS packets in 
the home network connected with the IEEE 1394 
connector, the TS packets from being recorded to 
other devices. 

(F) The above embodiments describe the case 
where an AV Clip of the Blu-ray Disc Read-Only For- 
mat is used as a digital stream, but the present in- 
vention can also be realized with a VOB (Video Ob- 
ject) of the DVD-Video Format orthe DVD-Video Re- 
cording Format. The VOB is a program stream that 
complies with the I SO/I EC 13818-1 Standard and Is 
obtained by multiplexing a video stream and an audio 
stream. Also, the video stream in the AV Clip may 
be an MPEG4 video stream or a WMV video stream. 
Further, the audio stream in the AV Clip may be a 
Linear PCM audio stream, an MP3 audio stream, or 
an MPEG-AAC audio stream. 

(G) The movie content described in the above em- 
bodiments may be obtained by encoding an analog 
image signal broadcast by analog broadcasting. Al- 
so, the movie content may be stream data made up 
of a transport stream broadcast by digital broadcast- 
ing. 

Alternatively, an analog/digital image signal record- 
ed on a videotape may be encoded to obtain content. 
Also, an analog/digital image signal directly captured 
by a video camera may be encoded to obtain content. 
A digital work distributed by a distribution server is 
applicable too. 

(H) Graphics Objects described in the above embod- 
iments is run-length encoded raster data. Run-length 
encoding is used for compression/encoding of 
graphics Objects, because the run-length encoding 
is most suitable for compression and decompression 
of subtitles. Subtitles have a property in that a con- 
tinuous length of the same pixel value in a horizontal 
direction is relatively long. Therefore, by performing 
compression using run-length encoding, a high com- 
pression rate can be attained. In addition, run-length 
encoding reduces a load for decompression, and is 
therefore suitablef or realizing decoding by software. 
Forthe purpose of providing a decoding construction 
common to subtitles and Buttons, the compression 
and decompression method usedforsubtitles is also 
employed for Buttons. Nevertheless, the use of 
run-length encoding for graphics Objects is not a lim- 
itation of the present invention. For example, graph- 
ics Objects may be PNG data. Also, graphics Objects 
may be vector data instead of raster data. Further, 
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graphics Objects may be transparent patterns. 
(I) Subtitle graphics selected according to a display 
setting of the playback apparatus may be subjected 
to display effects of PCSs. For example, graphics of 
various display modes such as wide screen, pan and 
scan, and letterbox are recorded on the BD-ROM, 
and the playback apparatus selects one of these dis- 
play modes according to a display setting of the tel- 
evision connected with the playback apparatus and 
displays corresponding graphics. Since the display 
effects of PCSs are applied to such subtitle graphics, 
viewability increases. As a result, display effects 
achieved by using characters which are contained 
within the body of video can be realized with subtitle 
graphics displayed according to the display setting. 
This contributes to high practicality. 
(J) The above embodiments describe the case 
where the playback apparatus includes a Graphics 
Plane. Alternatively, the playback apparatus may in- 
clude a line buffer for storing uncompressed pixels 
of one line. Since conversion to an image signal is 
performed for each horizontal row (line), conversion 
to an image signal can equally be performed with 
the line buffer. 

(K) The third embodiment describes the case where 
button commandsfor setting PSR1 0 and PSR1 1 are 
written in an ICS, but button commands for setting 
PSR1, PSR2, and PSR3 may be written in the ICS 
too. Forexample, if PSR2specifies English subtitles, 
button commands for selecting Japanese subtitles 
may be provided. 

(L) A default Button may be provided on each of an 
audio seiectionmenu and a subtitle selectionmenu 
used for receiving an audio stream selection and a 
subtitle stream selection. Button information corre- 
sponding to such a default Button has button com- 
mands for setting PSR1 or PSR2 to an undefined 
value. If the default Button is activated and these 
button commands are executed, PSR1 or PSR2 is 
set to the undefined value, and "Procedure when 
playback condition is changed" is performed to se- 
lect an optimal audio stream or PG JextST_ stream. 
(M) The first embodiment describes the case where 
the three conditions (a) to (c) are used, but the 
number of conditions may be four or more. 

Industrial Applicability 

[0345] The above embodiments disclose the internal 
construction of the playback apparatus to which the 
present invention relates, and the playback apparatus 
can be manufactured in volume based on the disclosed 
internal construction. In other words, the playback appa- 
ratus are capable of being industrially used. Hence the 
playback apparatus has industrial applicability. 
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1. A playback apparatus for playing back a digital 
stream generated by multiplexing a plurality of ele- 
mentary streams, comprising: 

a judgment unit operable to judge, for each el- 
ementary stream, which of a plurality of prede- 
termined conditions the elementary stream sat- 
isfies; and 

a playback unit operable to assign a priority to 
each elementary stream according to a pattern 
of conditions the elementary stream satisfies, 
and select and play back a highest-priority ele- 
mentary stream. 

2. The playback apparatus of Claim 1 , wherein 

the playback unit assigns a higher priority to the el- 
ementary stream if the elementary stream s: 
more conditions. 



3. The playback apparatus of Claim 1 , wherein: 
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the plurality of predetermined conditions include 
a first condition, a second condition, and 8 third 
condition; 

the first condition is that the playback apparatus 
has a capability of playing back the elementary s 

stream; 

the second condition is that a language attribute 
of the elementary stream matches a language 
setting of the playback apparatus; 
the third condition is that a channel attribute of 10 
the elementary stream is surround sound and 
the playback apparatus has a surround output 
capability; and 

the playback unit assigns a higher prionty to the 
elementary stream if the elementary stream sat- '5 
isfies the first condition and the second condi- 
tion, than if the elementary stream satisfies the 
first condition and the third condition. 

The playback apparatus of Claim 1 , further compris- 20 



ing 

a status register, wherein 

the playback unit performs the selection by setting 
a stream number of the highest-priority elementary 
stream in the status register. 

The playback apparatus of Claim 4, wherein: 

a plurality of sets of playback section information 
are recorded on a recording medium; 
the judgment by the judgment unit and the se- 
lection by the playback unit are performed when 
playback according to one of the plurality of sets 
of playback section information begins; and 
the status register is set tobe invalid when the 
playback according to the set of playback sec- 
tion information ends. 



7. The playback apparatus of Claim6, furthercompris- 
ing 

a reception unit operable to receive a user operation, 
wherein 

the acquisition unit acquires the switching destina- 
tion stream number based on the user operation re- 
ceived by the reception unit. 

8. The playback apparatus of Claim 6, further compris- 

an execution unit operable to execute a command 
recorded on a recording medium, wherein 
the acquisition unit acquires the switching destina- 
tion stream number based on the command execut- 
ed by the execution unit. 

9. The playback apparatus of Claim 6, wherein 

the switching destination stream number is invalid if 
the switching destination stream number exceeds a 
number of entries in a predetermined table. 

10. The playback apparatus of Claim 4, further compris- 
ing 

a setting unit operable to set a predetermined unde- 
fined value in the status register when a recording 
medium is loaded to the playback apparatus, where- 

the judgment by the judgment unit and the selection 
by the playback unit are performed if a set value of 
the status register is the predetermined undefined 
value. 

11. A computer-readable program used for enabling a 
computer to play back a digital stream generated by 
multiplexing a plurality of elementary streams, the 
program enabling the computer to perform the steps 



The playback apparatus of Claim 4, further compris 



an acquisition unit operable to acquire, when a 
stream switching request is made, a switching 
destination stream number; and 
a setting unit operable to set, if the switching 
destination stream number is valid, the switch- 
ing destination stream number in the status reg- 
ister, wherein: 

if the switching destination stream number 
is invalid, a set value of the status register 
is maintained; and 

the judgment by the judgment unit and the 
selection by the playback unit are per- 
formed if the switching destination stream 
number is a predetermined undefined val- 
ue. 



judging, for each elementary stream, which of a 
plurality of predetermined conditions the ele- 
mentary stream satisfies; and 
assigning a priorityto each elementary stream 
according to a pattern of conditions the elemen- 
tary stream satisfies, and selecting and playing 
back a highest-priority elementary stream. 

12. A playback method of playing back a digital stream- 
generated by multiplexing a plurality of elementary 
streams, comprising the steps of: 

judging, for each elementary stream, which of a 
plurality of predetermined conditions the ele- 
mentary stream satisfies; and 
as signing a priority to each elementary stream 
according to a pattern of conditions the elemen- 
tary stream satisfies, and selecting and playing 
back a highest-priority elementary stream. 
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